2023-02-08 13:02:44,856 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-08 13:02:44,901 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=168, ProcessCount=165, AvailableMemoryMB=5316 2023-02-08 13:02:45,176 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5 2023-02-08 13:02:45,186 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 13:02:45,186 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/cluster_ff6f2350-4145-97b2-4cd5-e4e4c6d6f903, deleteOnExit=true 2023-02-08 13:02:45,187 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 13:02:45,188 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/test.cache.data in system properties and HBase conf 2023-02-08 13:02:45,188 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 13:02:45,189 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/hadoop.log.dir in system properties and HBase conf 2023-02-08 13:02:45,189 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 13:02:45,190 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 13:02:45,190 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 13:02:45,289 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-08 13:02:45,670 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 13:02:45,675 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:02:45,675 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:02:45,676 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 13:02:45,676 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:02:45,676 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 13:02:45,677 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 13:02:45,677 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:02:45,677 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:02:45,678 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 13:02:45,678 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/nfs.dump.dir in system properties and HBase conf 2023-02-08 13:02:45,678 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/java.io.tmpdir in system properties and HBase conf 2023-02-08 13:02:45,679 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:02:45,679 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 13:02:45,680 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 13:02:46,152 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:02:46,156 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:02:46,454 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-08 13:02:46,626 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-08 13:02:46,641 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:02:46,681 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:02:46,718 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/java.io.tmpdir/Jetty_localhost_39987_hdfs____.7wie10/webapp 2023-02-08 13:02:46,869 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39987 2023-02-08 13:02:46,881 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:02:46,881 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:02:47,441 WARN [Listener at localhost/46787] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:02:47,523 WARN [Listener at localhost/46787] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:02:47,551 WARN [Listener at localhost/46787] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:02:47,559 INFO [Listener at localhost/46787] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:02:47,567 INFO [Listener at localhost/46787] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/java.io.tmpdir/Jetty_localhost_36955_datanode____re1nwd/webapp 2023-02-08 13:02:47,683 INFO [Listener at localhost/46787] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36955 2023-02-08 13:02:48,132 WARN [Listener at localhost/40427] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:02:48,181 WARN [Listener at localhost/40427] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:02:48,188 WARN [Listener at localhost/40427] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:02:48,190 INFO [Listener at localhost/40427] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:02:48,201 INFO [Listener at localhost/40427] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/java.io.tmpdir/Jetty_localhost_45127_datanode____g747ss/webapp 2023-02-08 13:02:48,325 INFO [Listener at localhost/40427] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45127 2023-02-08 13:02:48,344 WARN [Listener at localhost/41037] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:02:48,642 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x17da9547fe04b9e0: Processing first storage report for DS-13322d9d-47f6-4a5c-b6bd-7d05df5a6a0b from datanode d5702c49-41c4-4c22-aae7-e95657a3213f 2023-02-08 13:02:48,644 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x17da9547fe04b9e0: from storage DS-13322d9d-47f6-4a5c-b6bd-7d05df5a6a0b node DatanodeRegistration(127.0.0.1:39863, datanodeUuid=d5702c49-41c4-4c22-aae7-e95657a3213f, infoPort=42509, infoSecurePort=0, ipcPort=40427, storageInfo=lv=-57;cid=testClusterID;nsid=899118756;c=1675861366230), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-08 13:02:48,644 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7a4dd7d1d92e6b2d: Processing first storage report for DS-7dec7059-bbeb-40b9-9738-088640b1e3b5 from datanode 8ae96d40-2da7-4eda-98d1-1f1626223e29 2023-02-08 13:02:48,644 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7a4dd7d1d92e6b2d: from storage DS-7dec7059-bbeb-40b9-9738-088640b1e3b5 node DatanodeRegistration(127.0.0.1:35991, datanodeUuid=8ae96d40-2da7-4eda-98d1-1f1626223e29, infoPort=40677, infoSecurePort=0, ipcPort=41037, storageInfo=lv=-57;cid=testClusterID;nsid=899118756;c=1675861366230), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:02:48,644 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x17da9547fe04b9e0: Processing first storage report for DS-24b878d9-b80a-4e86-9229-dac55628ce58 from datanode d5702c49-41c4-4c22-aae7-e95657a3213f 2023-02-08 13:02:48,644 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x17da9547fe04b9e0: from storage DS-24b878d9-b80a-4e86-9229-dac55628ce58 node DatanodeRegistration(127.0.0.1:39863, datanodeUuid=d5702c49-41c4-4c22-aae7-e95657a3213f, infoPort=42509, infoSecurePort=0, ipcPort=40427, storageInfo=lv=-57;cid=testClusterID;nsid=899118756;c=1675861366230), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:02:48,645 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7a4dd7d1d92e6b2d: Processing first storage report for DS-d15e7385-f2b2-44a4-92dc-f534b2965cfb from datanode 8ae96d40-2da7-4eda-98d1-1f1626223e29 2023-02-08 13:02:48,645 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7a4dd7d1d92e6b2d: from storage DS-d15e7385-f2b2-44a4-92dc-f534b2965cfb node DatanodeRegistration(127.0.0.1:35991, datanodeUuid=8ae96d40-2da7-4eda-98d1-1f1626223e29, infoPort=40677, infoSecurePort=0, ipcPort=41037, storageInfo=lv=-57;cid=testClusterID;nsid=899118756;c=1675861366230), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:02:48,764 DEBUG [Listener at localhost/41037] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5 2023-02-08 13:02:48,872 INFO [Listener at localhost/41037] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/cluster_ff6f2350-4145-97b2-4cd5-e4e4c6d6f903/zookeeper_0, clientPort=64435, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/cluster_ff6f2350-4145-97b2-4cd5-e4e4c6d6f903/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/cluster_ff6f2350-4145-97b2-4cd5-e4e4c6d6f903/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 13:02:48,887 INFO [Listener at localhost/41037] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64435 2023-02-08 13:02:48,895 INFO [Listener at localhost/41037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:02:48,897 INFO [Listener at localhost/41037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:02:49,561 INFO [Listener at localhost/41037] util.FSUtils(479): Created version file at hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7 with version=8 2023-02-08 13:02:49,561 INFO [Listener at localhost/41037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:02:49,563 INFO [Listener at localhost/41037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:02:49,566 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/hbase-staging 2023-02-08 13:02:49,892 INFO [Listener at localhost/41037] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-08 13:02:50,367 INFO [Listener at localhost/41037] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:02:50,400 INFO [Listener at localhost/41037] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:02:50,400 INFO [Listener at localhost/41037] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:02:50,400 INFO [Listener at localhost/41037] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:02:50,400 INFO [Listener at localhost/41037] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:02:50,401 INFO [Listener at localhost/41037] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:02:50,537 INFO [Listener at localhost/41037] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:02:50,607 DEBUG [Listener at localhost/41037] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-08 13:02:50,741 INFO [Listener at localhost/41037] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33715 2023-02-08 13:02:50,754 INFO [Listener at localhost/41037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:02:50,757 INFO [Listener at localhost/41037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:02:50,782 INFO [Listener at localhost/41037] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33715 connecting to ZooKeeper ensemble=127.0.0.1:64435 2023-02-08 13:02:50,833 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:337150x0, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:02:50,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33715-0x100340709d30000 connected 2023-02-08 13:02:50,863 DEBUG [Listener at localhost/41037] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:02:50,864 DEBUG [Listener at localhost/41037] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:02:50,867 DEBUG [Listener at localhost/41037] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:02:50,875 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33715 2023-02-08 13:02:50,876 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33715 2023-02-08 13:02:50,880 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33715 2023-02-08 13:02:50,880 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33715 2023-02-08 13:02:50,880 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33715 2023-02-08 13:02:50,887 INFO [Listener at localhost/41037] master.HMaster(439): hbase.rootdir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7, hbase.cluster.distributed=false 2023-02-08 13:02:50,954 INFO [Listener at localhost/41037] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:02:50,955 INFO [Listener at localhost/41037] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:02:50,955 INFO [Listener at localhost/41037] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:02:50,955 INFO [Listener at localhost/41037] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:02:50,955 INFO [Listener at localhost/41037] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:02:50,955 INFO [Listener at localhost/41037] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:02:50,960 INFO [Listener at localhost/41037] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:02:50,963 INFO [Listener at localhost/41037] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45759 2023-02-08 13:02:50,965 INFO [Listener at localhost/41037] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:02:50,972 DEBUG [Listener at localhost/41037] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:02:50,973 INFO [Listener at localhost/41037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:02:50,975 INFO [Listener at localhost/41037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:02:50,977 INFO [Listener at localhost/41037] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45759 connecting to ZooKeeper ensemble=127.0.0.1:64435 2023-02-08 13:02:50,982 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:457590x0, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:02:50,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45759-0x100340709d30001 connected 2023-02-08 13:02:50,983 DEBUG [Listener at localhost/41037] zookeeper.ZKUtil(164): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:02:50,984 DEBUG [Listener at localhost/41037] zookeeper.ZKUtil(164): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:02:50,985 DEBUG [Listener at localhost/41037] zookeeper.ZKUtil(164): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:02:50,986 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45759 2023-02-08 13:02:50,986 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45759 2023-02-08 13:02:50,987 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45759 2023-02-08 13:02:50,987 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45759 2023-02-08 13:02:50,987 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45759 2023-02-08 13:02:51,001 INFO [Listener at localhost/41037] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:02:51,001 INFO [Listener at localhost/41037] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:02:51,001 INFO [Listener at localhost/41037] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:02:51,002 INFO [Listener at localhost/41037] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:02:51,002 INFO [Listener at localhost/41037] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:02:51,002 INFO [Listener at localhost/41037] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:02:51,002 INFO [Listener at localhost/41037] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:02:51,004 INFO [Listener at localhost/41037] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42029 2023-02-08 13:02:51,005 INFO [Listener at localhost/41037] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:02:51,006 DEBUG [Listener at localhost/41037] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:02:51,007 INFO [Listener at localhost/41037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:02:51,010 INFO [Listener at localhost/41037] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:02:51,012 INFO [Listener at localhost/41037] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42029 connecting to ZooKeeper ensemble=127.0.0.1:64435 2023-02-08 13:02:51,016 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:420290x0, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:02:51,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42029-0x100340709d30002 connected 2023-02-08 13:02:51,017 DEBUG [Listener at localhost/41037] zookeeper.ZKUtil(164): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:02:51,018 DEBUG [Listener at localhost/41037] zookeeper.ZKUtil(164): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:02:51,019 DEBUG [Listener at localhost/41037] zookeeper.ZKUtil(164): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:02:51,020 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42029 2023-02-08 13:02:51,024 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42029 2023-02-08 13:02:51,024 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42029 2023-02-08 13:02:51,025 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42029 2023-02-08 13:02:51,025 DEBUG [Listener at localhost/41037] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42029 2023-02-08 13:02:51,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33715,1675861369728 2023-02-08 13:02:51,037 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:02:51,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33715,1675861369728 2023-02-08 13:02:51,059 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:02:51,059 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:02:51,059 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:02:51,059 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:02:51,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:02:51,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33715,1675861369728 from backup master directory 2023-02-08 13:02:51,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:02:51,065 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33715,1675861369728 2023-02-08 13:02:51,065 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:02:51,066 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:02:51,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,33715,1675861369728 2023-02-08 13:02:51,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-08 13:02:51,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-08 13:02:51,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/hbase.id with ID: 06bd80de-c81a-4568-ac89-bf5ca4b0f752 2023-02-08 13:02:51,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:02:51,218 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:02:51,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x630bd2e7 to 127.0.0.1:64435 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:02:51,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2339d3e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:02:51,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:02:51,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 13:02:51,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-08 13:02:51,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-08 13:02:51,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-08 13:02:51,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-08 13:02:51,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:02:51,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/MasterData/data/master/store-tmp 2023-02-08 13:02:51,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:51,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:02:51,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:02:51,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:02:51,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:02:51,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:02:51,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:02:51,430 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861371428Disabling compacts and flushes for region at 1675861371429 (+1 ms)Disabling writes for close at 1675861371429Writing region close event to WAL at 1675861371429Closed at 1675861371429 2023-02-08 13:02:51,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/MasterData/WALs/jenkins-hbase4.apache.org,33715,1675861369728 2023-02-08 13:02:51,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33715%2C1675861369728, suffix=, logDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/MasterData/WALs/jenkins-hbase4.apache.org,33715,1675861369728, archiveDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/MasterData/oldWALs, maxLogs=10 2023-02-08 13:02:51,518 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39863,DS-13322d9d-47f6-4a5c-b6bd-7d05df5a6a0b,DISK] 2023-02-08 13:02:51,518 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35991,DS-7dec7059-bbeb-40b9-9738-088640b1e3b5,DISK] 2023-02-08 13:02:51,529 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-08 13:02:51,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/MasterData/WALs/jenkins-hbase4.apache.org,33715,1675861369728/jenkins-hbase4.apache.org%2C33715%2C1675861369728.1675861371463 2023-02-08 13:02:51,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35991,DS-7dec7059-bbeb-40b9-9738-088640b1e3b5,DISK], DatanodeInfoWithStorage[127.0.0.1:39863,DS-13322d9d-47f6-4a5c-b6bd-7d05df5a6a0b,DISK]] 2023-02-08 13:02:51,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:02:51,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:51,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:02:51,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:02:51,731 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:02:51,739 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 13:02:51,779 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 13:02:51,796 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:51,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:02:51,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:02:51,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:02:51,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:02:51,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65996414, jitterRate=-0.016576796770095825}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:02:51,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675861371681Initializing all the Stores at 1675861371684 (+3 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861371685 (+1 ms)Cleaning up temporary data from old regions at 1675861371817 (+132 ms)Cleaning up detritus from prior splits at 1675861371818 (+1 ms)Region opened successfully at 1675861371836 (+18 ms) 2023-02-08 13:02:51,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 13:02:51,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 13:02:51,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 13:02:51,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 13:02:51,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-08 13:02:51,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-02-08 13:02:51,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 13:02:51,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 13:02:51,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 13:02:51,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 13:02:51,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 13:02:51,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 13:02:51,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 13:02:51,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 13:02:51,980 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:02:51,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 13:02:51,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 13:02:51,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 13:02:51,999 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:02:51,999 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:02:51,999 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:02:51,999 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:02:52,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,33715,1675861369728, sessionid=0x100340709d30000, setting cluster-up flag (Was=false) 2023-02-08 13:02:52,021 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:02:52,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 13:02:52,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33715,1675861369728 2023-02-08 13:02:52,039 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:02:52,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 13:02:52,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33715,1675861369728 2023-02-08 13:02:52,049 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.hbase-snapshot/.tmp 2023-02-08 13:02:52,131 INFO [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(952): ClusterId : 06bd80de-c81a-4568-ac89-bf5ca4b0f752 2023-02-08 13:02:52,131 INFO [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(952): ClusterId : 06bd80de-c81a-4568-ac89-bf5ca4b0f752 2023-02-08 13:02:52,139 DEBUG [RS:1;jenkins-hbase4:42029] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:02:52,139 DEBUG [RS:0;jenkins-hbase4:45759] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:02:52,147 DEBUG [RS:0;jenkins-hbase4:45759] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:02:52,147 DEBUG [RS:1;jenkins-hbase4:42029] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:02:52,147 DEBUG [RS:0;jenkins-hbase4:45759] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:02:52,148 DEBUG [RS:1;jenkins-hbase4:42029] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:02:52,152 DEBUG [RS:1;jenkins-hbase4:42029] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:02:52,152 DEBUG [RS:0;jenkins-hbase4:45759] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:02:52,154 DEBUG [RS:1;jenkins-hbase4:42029] zookeeper.ReadOnlyZKClient(139): Connect 0x037f54ad to 127.0.0.1:64435 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:02:52,154 DEBUG [RS:0;jenkins-hbase4:45759] zookeeper.ReadOnlyZKClient(139): Connect 0x03fb9627 to 127.0.0.1:64435 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:02:52,166 DEBUG [RS:1;jenkins-hbase4:42029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11a457df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:02:52,167 DEBUG [RS:0;jenkins-hbase4:45759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69d1914b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:02:52,167 DEBUG [RS:1;jenkins-hbase4:42029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@476c6bc1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:02:52,167 DEBUG [RS:0;jenkins-hbase4:45759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b03343a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:02:52,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 13:02:52,187 DEBUG [RS:1;jenkins-hbase4:42029] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42029 2023-02-08 13:02:52,192 DEBUG [RS:0;jenkins-hbase4:45759] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45759 2023-02-08 13:02:52,193 INFO [RS:1;jenkins-hbase4:42029] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:02:52,193 INFO [RS:0;jenkins-hbase4:45759] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:02:52,193 INFO [RS:1;jenkins-hbase4:42029] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:02:52,193 INFO [RS:0;jenkins-hbase4:45759] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:02:52,193 DEBUG [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:02:52,193 DEBUG [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:02:52,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:02:52,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:02:52,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:02:52,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:02:52,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 13:02:52,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:02:52,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675861402196 2023-02-08 13:02:52,196 INFO [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33715,1675861369728 with isa=jenkins-hbase4.apache.org/172.31.14.131:42029, startcode=1675861371000 2023-02-08 13:02:52,196 INFO [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33715,1675861369728 with isa=jenkins-hbase4.apache.org/172.31.14.131:45759, startcode=1675861370954 2023-02-08 13:02:52,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 13:02:52,203 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:02:52,204 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 13:02:52,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 13:02:52,211 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:02:52,216 DEBUG [RS:1;jenkins-hbase4:42029] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:02:52,216 DEBUG [RS:0;jenkins-hbase4:45759] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:02:52,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 13:02:52,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 13:02:52,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 13:02:52,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 13:02:52,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 13:02:52,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 13:02:52,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 13:02:52,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 13:02:52,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 13:02:52,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861372230,5,FailOnTimeoutGroup] 2023-02-08 13:02:52,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861372230,5,FailOnTimeoutGroup] 2023-02-08 13:02:52,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 13:02:52,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,261 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:02:52,263 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:02:52,263 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7 2023-02-08 13:02:52,287 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58265, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:02:52,287 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53277, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:02:52,289 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:52,293 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:02:52,296 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/info 2023-02-08 13:02:52,297 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:02:52,298 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:52,298 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:02:52,301 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:02:52,301 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:02:52,302 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33715] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:52,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:52,303 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:52,303 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:02:52,306 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/table 2023-02-08 13:02:52,306 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:02:52,307 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:52,309 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740 2023-02-08 13:02:52,310 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740 2023-02-08 13:02:52,315 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:02:52,318 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:02:52,320 DEBUG [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7 2023-02-08 13:02:52,320 DEBUG [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46787 2023-02-08 13:02:52,320 DEBUG [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:02:52,320 DEBUG [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7 2023-02-08 13:02:52,320 DEBUG [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46787 2023-02-08 13:02:52,320 DEBUG [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:02:52,322 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:02:52,324 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69639472, jitterRate=0.03770899772644043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:02:52,324 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675861372290Initializing all the Stores at 1675861372291 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861372292 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861372292Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861372292Cleaning up temporary data from old regions at 1675861372312 (+20 ms)Cleaning up detritus from prior splits at 1675861372312Region opened successfully at 1675861372324 (+12 ms) 2023-02-08 13:02:52,324 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:02:52,324 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:02:52,324 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:02:52,324 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:02:52,325 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:02:52,326 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:02:52,326 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861372324Disabling compacts and flushes for region at 1675861372324Disabling writes for close at 1675861372324Writing region close event to WAL at 1675861372326 (+2 ms)Closed at 1675861372326 2023-02-08 13:02:52,330 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:02:52,331 DEBUG [RS:1;jenkins-hbase4:42029] zookeeper.ZKUtil(162): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:52,331 DEBUG [RS:0;jenkins-hbase4:45759] zookeeper.ZKUtil(162): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:52,332 WARN [RS:1;jenkins-hbase4:42029] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:02:52,332 INFO [RS:1;jenkins-hbase4:42029] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:02:52,332 WARN [RS:0;jenkins-hbase4:45759] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:02:52,332 DEBUG [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/WALs/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:52,332 INFO [RS:0;jenkins-hbase4:45759] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:02:52,333 DEBUG [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/WALs/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:52,333 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:02:52,333 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 13:02:52,334 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45759,1675861370954] 2023-02-08 13:02:52,334 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42029,1675861371000] 2023-02-08 13:02:52,344 DEBUG [RS:1;jenkins-hbase4:42029] zookeeper.ZKUtil(162): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:52,345 DEBUG [RS:0;jenkins-hbase4:45759] zookeeper.ZKUtil(162): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:52,345 DEBUG [RS:1;jenkins-hbase4:42029] zookeeper.ZKUtil(162): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:52,345 DEBUG [RS:0;jenkins-hbase4:45759] zookeeper.ZKUtil(162): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:52,346 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 13:02:52,357 DEBUG [RS:1;jenkins-hbase4:42029] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:02:52,357 DEBUG [RS:0;jenkins-hbase4:45759] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:02:52,358 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 13:02:52,361 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 13:02:52,369 INFO [RS:0;jenkins-hbase4:45759] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:02:52,369 INFO [RS:1;jenkins-hbase4:42029] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:02:52,389 INFO [RS:1;jenkins-hbase4:42029] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:02:52,389 INFO [RS:0;jenkins-hbase4:45759] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:02:52,393 INFO [RS:1;jenkins-hbase4:42029] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:02:52,393 INFO [RS:0;jenkins-hbase4:45759] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:02:52,394 INFO [RS:1;jenkins-hbase4:42029] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,394 INFO [RS:0;jenkins-hbase4:45759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,395 INFO [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:02:52,395 INFO [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:02:52,403 INFO [RS:0;jenkins-hbase4:45759] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,403 INFO [RS:1;jenkins-hbase4:42029] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,404 DEBUG [RS:0;jenkins-hbase4:45759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,404 DEBUG [RS:1;jenkins-hbase4:42029] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,404 DEBUG [RS:0;jenkins-hbase4:45759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,404 DEBUG [RS:1;jenkins-hbase4:42029] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,404 DEBUG [RS:0;jenkins-hbase4:45759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,404 DEBUG [RS:1;jenkins-hbase4:42029] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,404 DEBUG [RS:0;jenkins-hbase4:45759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,404 DEBUG [RS:1;jenkins-hbase4:42029] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,405 DEBUG [RS:0;jenkins-hbase4:45759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,405 DEBUG [RS:1;jenkins-hbase4:42029] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,405 DEBUG [RS:0;jenkins-hbase4:45759] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:02:52,405 DEBUG [RS:1;jenkins-hbase4:42029] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:02:52,405 DEBUG [RS:0;jenkins-hbase4:45759] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,405 DEBUG [RS:1;jenkins-hbase4:42029] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,405 DEBUG [RS:0;jenkins-hbase4:45759] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,405 DEBUG [RS:1;jenkins-hbase4:42029] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,405 DEBUG [RS:0;jenkins-hbase4:45759] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,405 DEBUG [RS:1;jenkins-hbase4:42029] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,406 DEBUG [RS:0;jenkins-hbase4:45759] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,406 DEBUG [RS:1;jenkins-hbase4:42029] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:02:52,408 INFO [RS:0;jenkins-hbase4:45759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,408 INFO [RS:0;jenkins-hbase4:45759] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,408 INFO [RS:1;jenkins-hbase4:42029] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,408 INFO [RS:0;jenkins-hbase4:45759] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,408 INFO [RS:1;jenkins-hbase4:42029] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,409 INFO [RS:1;jenkins-hbase4:42029] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,426 INFO [RS:1;jenkins-hbase4:42029] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:02:52,426 INFO [RS:0;jenkins-hbase4:45759] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:02:52,429 INFO [RS:0;jenkins-hbase4:45759] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45759,1675861370954-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,429 INFO [RS:1;jenkins-hbase4:42029] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42029,1675861371000-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,447 INFO [RS:0;jenkins-hbase4:45759] regionserver.Replication(203): jenkins-hbase4.apache.org,45759,1675861370954 started 2023-02-08 13:02:52,447 INFO [RS:1;jenkins-hbase4:42029] regionserver.Replication(203): jenkins-hbase4.apache.org,42029,1675861371000 started 2023-02-08 13:02:52,447 INFO [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45759,1675861370954, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45759, sessionid=0x100340709d30001 2023-02-08 13:02:52,447 INFO [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42029,1675861371000, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42029, sessionid=0x100340709d30002 2023-02-08 13:02:52,448 DEBUG [RS:0;jenkins-hbase4:45759] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:02:52,448 DEBUG [RS:1;jenkins-hbase4:42029] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:02:52,448 DEBUG [RS:0;jenkins-hbase4:45759] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:52,448 DEBUG [RS:1;jenkins-hbase4:42029] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:52,449 DEBUG [RS:0;jenkins-hbase4:45759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45759,1675861370954' 2023-02-08 13:02:52,449 DEBUG [RS:1;jenkins-hbase4:42029] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42029,1675861371000' 2023-02-08 13:02:52,449 DEBUG [RS:1;jenkins-hbase4:42029] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:02:52,449 DEBUG [RS:0;jenkins-hbase4:45759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:02:52,450 DEBUG [RS:1;jenkins-hbase4:42029] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:02:52,450 DEBUG [RS:0;jenkins-hbase4:45759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:02:52,451 DEBUG [RS:1;jenkins-hbase4:42029] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:02:52,451 DEBUG [RS:1;jenkins-hbase4:42029] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:02:52,451 DEBUG [RS:1;jenkins-hbase4:42029] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:52,451 DEBUG [RS:0;jenkins-hbase4:45759] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:02:52,451 DEBUG [RS:1;jenkins-hbase4:42029] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42029,1675861371000' 2023-02-08 13:02:52,451 DEBUG [RS:0;jenkins-hbase4:45759] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:02:52,451 DEBUG [RS:1;jenkins-hbase4:42029] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:02:52,451 DEBUG [RS:0;jenkins-hbase4:45759] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:52,452 DEBUG [RS:0;jenkins-hbase4:45759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45759,1675861370954' 2023-02-08 13:02:52,452 DEBUG [RS:0;jenkins-hbase4:45759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:02:52,452 DEBUG [RS:1;jenkins-hbase4:42029] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:02:52,453 DEBUG [RS:0;jenkins-hbase4:45759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:02:52,453 DEBUG [RS:1;jenkins-hbase4:42029] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:02:52,453 INFO [RS:1;jenkins-hbase4:42029] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:02:52,453 INFO [RS:1;jenkins-hbase4:42029] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:02:52,453 DEBUG [RS:0;jenkins-hbase4:45759] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:02:52,453 INFO [RS:0;jenkins-hbase4:45759] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:02:52,454 INFO [RS:0;jenkins-hbase4:45759] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:02:52,513 DEBUG [jenkins-hbase4:33715] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 13:02:52,518 DEBUG [jenkins-hbase4:33715] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:02:52,523 DEBUG [jenkins-hbase4:33715] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:02:52,523 DEBUG [jenkins-hbase4:33715] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:02:52,523 DEBUG [jenkins-hbase4:33715] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:02:52,526 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42029,1675861371000, state=OPENING 2023-02-08 13:02:52,534 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 13:02:52,535 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:02:52,536 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:02:52,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42029,1675861371000}] 2023-02-08 13:02:52,725 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:52,727 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 13:02:52,730 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43892, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 13:02:52,745 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 13:02:52,745 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:02:52,748 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42029%2C1675861371000.meta, suffix=.meta, logDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/WALs/jenkins-hbase4.apache.org,42029,1675861371000, archiveDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/oldWALs, maxLogs=32 2023-02-08 13:02:52,768 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35991,DS-7dec7059-bbeb-40b9-9738-088640b1e3b5,DISK] 2023-02-08 13:02:52,768 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39863,DS-13322d9d-47f6-4a5c-b6bd-7d05df5a6a0b,DISK] 2023-02-08 13:02:52,772 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/WALs/jenkins-hbase4.apache.org,42029,1675861371000/jenkins-hbase4.apache.org%2C42029%2C1675861371000.meta.1675861372751.meta 2023-02-08 13:02:52,773 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35991,DS-7dec7059-bbeb-40b9-9738-088640b1e3b5,DISK], DatanodeInfoWithStorage[127.0.0.1:39863,DS-13322d9d-47f6-4a5c-b6bd-7d05df5a6a0b,DISK]] 2023-02-08 13:02:52,774 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:02:52,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 13:02:52,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 13:02:52,797 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 13:02:52,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 13:02:52,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:52,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 13:02:52,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 13:02:52,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:02:52,807 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/info 2023-02-08 13:02:52,807 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/info 2023-02-08 13:02:52,807 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:02:52,808 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:52,809 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:02:52,810 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:02:52,810 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:02:52,811 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:02:52,811 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:52,812 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:02:52,813 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/table 2023-02-08 13:02:52,813 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/table 2023-02-08 13:02:52,814 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:02:52,814 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:52,816 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740 2023-02-08 13:02:52,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740 2023-02-08 13:02:52,823 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:02:52,825 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:02:52,826 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60455494, jitterRate=-0.09914293885231018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:02:52,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675861372802Writing region info on filesystem at 1675861372803 (+1 ms)Initializing all the Stores at 1675861372804 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861372805 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861372805Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861372805Cleaning up temporary data from old regions at 1675861372821 (+16 ms)Cleaning up detritus from prior splits at 1675861372821Running coprocessor post-open hooks at 1675861372826 (+5 ms)Region opened successfully at 1675861372826 2023-02-08 13:02:52,836 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675861372717 2023-02-08 13:02:52,854 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 13:02:52,855 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 13:02:52,855 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42029,1675861371000, state=OPEN 2023-02-08 13:02:52,859 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 13:02:52,859 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:02:52,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 13:02:52,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42029,1675861371000 in 320 msec 2023-02-08 13:02:52,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 13:02:52,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 518 msec 2023-02-08 13:02:52,878 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 772 msec 2023-02-08 13:02:52,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675861371054, completionTime=-1 2023-02-08 13:02:52,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 13:02:52,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 13:02:52,953 DEBUG [hconnection-0x55c0a1ee-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:02:52,955 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43900, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:02:52,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 13:02:52,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675861432972 2023-02-08 13:02:52,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675861492972 2023-02-08 13:02:52,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 93 msec 2023-02-08 13:02:52,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33715,1675861369728-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33715,1675861369728-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33715,1675861369728-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33715, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:52,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 13:02:53,005 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 13:02:53,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 13:02:53,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:02:53,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 13:02:53,027 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:02:53,030 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:02:53,050 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/hbase/namespace/4d6569ef9a17357359db3c109d2811f5 2023-02-08 13:02:53,053 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/hbase/namespace/4d6569ef9a17357359db3c109d2811f5 empty. 2023-02-08 13:02:53,054 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/hbase/namespace/4d6569ef9a17357359db3c109d2811f5 2023-02-08 13:02:53,054 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 13:02:53,079 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 13:02:53,081 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4d6569ef9a17357359db3c109d2811f5, NAME => 'hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp 2023-02-08 13:02:53,096 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:53,096 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4d6569ef9a17357359db3c109d2811f5, disabling compactions & flushes 2023-02-08 13:02:53,097 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. 2023-02-08 13:02:53,097 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. 2023-02-08 13:02:53,097 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. after waiting 0 ms 2023-02-08 13:02:53,097 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. 2023-02-08 13:02:53,097 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. 2023-02-08 13:02:53,097 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4d6569ef9a17357359db3c109d2811f5: Waiting for close lock at 1675861373096Disabling compacts and flushes for region at 1675861373096Disabling writes for close at 1675861373097 (+1 ms)Writing region close event to WAL at 1675861373097Closed at 1675861373097 2023-02-08 13:02:53,102 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:02:53,117 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861373105"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861373105"}]},"ts":"1675861373105"} 2023-02-08 13:02:53,144 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 13:02:53,146 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:02:53,150 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861373146"}]},"ts":"1675861373146"} 2023-02-08 13:02:53,155 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 13:02:53,158 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:02:53,160 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:02:53,160 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:02:53,160 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:02:53,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4d6569ef9a17357359db3c109d2811f5, ASSIGN}] 2023-02-08 13:02:53,167 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4d6569ef9a17357359db3c109d2811f5, ASSIGN 2023-02-08 13:02:53,169 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4d6569ef9a17357359db3c109d2811f5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45759,1675861370954; forceNewPlan=false, retain=false 2023-02-08 13:02:53,322 INFO [jenkins-hbase4:33715] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 13:02:53,323 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4d6569ef9a17357359db3c109d2811f5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:53,324 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861373323"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861373323"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861373323"}]},"ts":"1675861373323"} 2023-02-08 13:02:53,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4d6569ef9a17357359db3c109d2811f5, server=jenkins-hbase4.apache.org,45759,1675861370954}] 2023-02-08 13:02:53,464 INFO [RS:0;jenkins-hbase4:45759] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45759%2C1675861370954, suffix=, logDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/WALs/jenkins-hbase4.apache.org,45759,1675861370954, archiveDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/oldWALs, maxLogs=32 2023-02-08 13:02:53,464 INFO [RS:1;jenkins-hbase4:42029] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42029%2C1675861371000, suffix=, logDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/WALs/jenkins-hbase4.apache.org,42029,1675861371000, archiveDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/oldWALs, maxLogs=32 2023-02-08 13:02:53,484 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35991,DS-7dec7059-bbeb-40b9-9738-088640b1e3b5,DISK] 2023-02-08 13:02:53,489 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:53,489 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 13:02:53,489 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35991,DS-7dec7059-bbeb-40b9-9738-088640b1e3b5,DISK] 2023-02-08 13:02:53,489 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39863,DS-13322d9d-47f6-4a5c-b6bd-7d05df5a6a0b,DISK] 2023-02-08 13:02:53,490 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39863,DS-13322d9d-47f6-4a5c-b6bd-7d05df5a6a0b,DISK] 2023-02-08 13:02:53,495 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50156, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 13:02:53,495 INFO [RS:0;jenkins-hbase4:45759] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/WALs/jenkins-hbase4.apache.org,45759,1675861370954/jenkins-hbase4.apache.org%2C45759%2C1675861370954.1675861373465 2023-02-08 13:02:53,496 INFO [RS:1;jenkins-hbase4:42029] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/WALs/jenkins-hbase4.apache.org,42029,1675861371000/jenkins-hbase4.apache.org%2C42029%2C1675861371000.1675861373466 2023-02-08 13:02:53,499 DEBUG [RS:0;jenkins-hbase4:45759] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39863,DS-13322d9d-47f6-4a5c-b6bd-7d05df5a6a0b,DISK], DatanodeInfoWithStorage[127.0.0.1:35991,DS-7dec7059-bbeb-40b9-9738-088640b1e3b5,DISK]] 2023-02-08 13:02:53,499 DEBUG [RS:1;jenkins-hbase4:42029] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35991,DS-7dec7059-bbeb-40b9-9738-088640b1e3b5,DISK], DatanodeInfoWithStorage[127.0.0.1:39863,DS-13322d9d-47f6-4a5c-b6bd-7d05df5a6a0b,DISK]] 2023-02-08 13:02:53,501 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. 2023-02-08 13:02:53,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4d6569ef9a17357359db3c109d2811f5, NAME => 'hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:02:53,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4d6569ef9a17357359db3c109d2811f5 2023-02-08 13:02:53,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:53,504 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4d6569ef9a17357359db3c109d2811f5 2023-02-08 13:02:53,504 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4d6569ef9a17357359db3c109d2811f5 2023-02-08 13:02:53,506 INFO [StoreOpener-4d6569ef9a17357359db3c109d2811f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4d6569ef9a17357359db3c109d2811f5 2023-02-08 13:02:53,509 DEBUG [StoreOpener-4d6569ef9a17357359db3c109d2811f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/namespace/4d6569ef9a17357359db3c109d2811f5/info 2023-02-08 13:02:53,509 DEBUG [StoreOpener-4d6569ef9a17357359db3c109d2811f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/namespace/4d6569ef9a17357359db3c109d2811f5/info 2023-02-08 13:02:53,509 INFO [StoreOpener-4d6569ef9a17357359db3c109d2811f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d6569ef9a17357359db3c109d2811f5 columnFamilyName info 2023-02-08 13:02:53,510 INFO [StoreOpener-4d6569ef9a17357359db3c109d2811f5-1] regionserver.HStore(310): Store=4d6569ef9a17357359db3c109d2811f5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:53,512 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/namespace/4d6569ef9a17357359db3c109d2811f5 2023-02-08 13:02:53,513 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/namespace/4d6569ef9a17357359db3c109d2811f5 2023-02-08 13:02:53,518 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4d6569ef9a17357359db3c109d2811f5 2023-02-08 13:02:53,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/namespace/4d6569ef9a17357359db3c109d2811f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:02:53,526 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4d6569ef9a17357359db3c109d2811f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73448063, jitterRate=0.09446142613887787}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:02:53,526 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4d6569ef9a17357359db3c109d2811f5: Running coprocessor pre-open hook at 1675861373504Writing region info on filesystem at 1675861373504Initializing all the Stores at 1675861373506 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861373506Cleaning up temporary data from old regions at 1675861373514 (+8 ms)Cleaning up detritus from prior splits at 1675861373515 (+1 ms)Running coprocessor post-open hooks at 1675861373526 (+11 ms)Region opened successfully at 1675861373526 2023-02-08 13:02:53,528 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5., pid=6, masterSystemTime=1675861373488 2023-02-08 13:02:53,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. 2023-02-08 13:02:53,533 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. 2023-02-08 13:02:53,534 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4d6569ef9a17357359db3c109d2811f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:53,535 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861373533"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861373533"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861373533"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861373533"}]},"ts":"1675861373533"} 2023-02-08 13:02:53,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 13:02:53,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4d6569ef9a17357359db3c109d2811f5, server=jenkins-hbase4.apache.org,45759,1675861370954 in 209 msec 2023-02-08 13:02:53,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 13:02:53,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4d6569ef9a17357359db3c109d2811f5, ASSIGN in 379 msec 2023-02-08 13:02:53,548 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:02:53,549 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861373548"}]},"ts":"1675861373548"} 2023-02-08 13:02:53,552 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 13:02:53,556 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:02:53,559 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 540 msec 2023-02-08 13:02:53,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 13:02:53,629 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:02:53,629 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:02:53,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:02:53,653 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:02:53,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 13:02:53,687 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:02:53,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-02-08 13:02:53,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 13:02:53,712 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:02:53,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-08 13:02:53,726 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 13:02:53,729 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 13:02:53,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.663sec 2023-02-08 13:02:53,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 13:02:53,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 13:02:53,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 13:02:53,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33715,1675861369728-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 13:02:53,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33715,1675861369728-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 13:02:53,739 DEBUG [Listener at localhost/41037] zookeeper.ReadOnlyZKClient(139): Connect 0x3b8ae91a to 127.0.0.1:64435 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:02:53,743 DEBUG [Listener at localhost/41037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b8795d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:02:53,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 13:02:53,786 DEBUG [hconnection-0x254e1275-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:02:53,798 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43380, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:02:53,808 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33715,1675861369728 2023-02-08 13:02:53,808 DEBUG [Listener at localhost/41037] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 13:02:53,810 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:53,810 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:53,817 DEBUG [Listener at localhost/41037] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 13:02:53,820 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50960, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 13:02:53,824 INFO [Listener at localhost/41037] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-08 13:02:53,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-08 13:02:53,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 13:02:53,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:50960 deadline: 1675861433827, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-08 13:02:53,845 INFO [Listener at localhost/41037] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-08 13:02:53,847 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:53,847 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:53,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:02:53,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-08 13:02:53,862 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:02:53,864 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:02:53,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-08 13:02:53,875 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:53,876 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:53,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:02:53,887 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:02:53,887 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:02:53,887 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:02:53,887 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce 2023-02-08 13:02:53,887 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119 2023-02-08 13:02:53,888 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7 2023-02-08 13:02:53,888 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:02:53,888 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:02:53,888 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119 empty. 2023-02-08 13:02:53,888 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce empty. 2023-02-08 13:02:53,889 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a empty. 2023-02-08 13:02:53,888 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84 empty. 2023-02-08 13:02:53,889 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3 empty. 2023-02-08 13:02:53,889 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e empty. 2023-02-08 13:02:53,890 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7 empty. 2023-02-08 13:02:53,891 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283 empty. 2023-02-08 13:02:53,891 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:02:53,891 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:02:53,891 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:02:53,891 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119 2023-02-08 13:02:53,891 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:02:53,891 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce 2023-02-08 13:02:53,892 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7 2023-02-08 13:02:53,891 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:02:53,891 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:02:53,892 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:02:53,892 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04 empty. 2023-02-08 13:02:53,892 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8 empty. 2023-02-08 13:02:53,893 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:02:53,893 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:02:53,893 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-08 13:02:53,916 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-08 13:02:53,919 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5dc36048c90a7ebfa122973d7d2b957e, NAME => 'testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp 2023-02-08 13:02:53,919 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7c6e8f9ce48294c939364df74fd31b84, NAME => 'testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp 2023-02-08 13:02:53,919 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4e6088dbda8e673c8279ecc67bbf1b4a, NAME => 'testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp 2023-02-08 13:02:53,957 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:53,958 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 4e6088dbda8e673c8279ecc67bbf1b4a, disabling compactions & flushes 2023-02-08 13:02:53,958 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:53,959 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:53,959 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. after waiting 0 ms 2023-02-08 13:02:53,959 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:53,959 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:53,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 4e6088dbda8e673c8279ecc67bbf1b4a: Waiting for close lock at 1675861373958Disabling compacts and flushes for region at 1675861373958Disabling writes for close at 1675861373959 (+1 ms)Writing region close event to WAL at 1675861373959Closed at 1675861373959 2023-02-08 13:02:53,961 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => a999f4c483c2e332d2532c44631561ce, NAME => 'testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp 2023-02-08 13:02:53,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:53,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 7c6e8f9ce48294c939364df74fd31b84, disabling compactions & flushes 2023-02-08 13:02:53,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:53,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:53,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. after waiting 0 ms 2023-02-08 13:02:53,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:53,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:53,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 7c6e8f9ce48294c939364df74fd31b84: Waiting for close lock at 1675861373964Disabling compacts and flushes for region at 1675861373964Disabling writes for close at 1675861373965 (+1 ms)Writing region close event to WAL at 1675861373965Closed at 1675861373965 2023-02-08 13:02:53,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 53392eb0fdd708840594d850c5b02119, NAME => 'testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp 2023-02-08 13:02:53,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:53,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 5dc36048c90a7ebfa122973d7d2b957e, disabling compactions & flushes 2023-02-08 13:02:53,967 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:53,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:53,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. after waiting 0 ms 2023-02-08 13:02:53,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:53,967 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:53,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 5dc36048c90a7ebfa122973d7d2b957e: Waiting for close lock at 1675861373967Disabling compacts and flushes for region at 1675861373967Disabling writes for close at 1675861373967Writing region close event to WAL at 1675861373967Closed at 1675861373967 2023-02-08 13:02:53,969 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 407e898b138d86648b3d6ad809a016b7, NAME => 'testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp 2023-02-08 13:02:53,986 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:53,987 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:53,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:02:53,995 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:53,995 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing a999f4c483c2e332d2532c44631561ce, disabling compactions & flushes 2023-02-08 13:02:53,995 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:53,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:53,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:53,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. after waiting 0 ms 2023-02-08 13:02:53,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 53392eb0fdd708840594d850c5b02119, disabling compactions & flushes 2023-02-08 13:02:53,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:53,996 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:53,996 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:53,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:53,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for a999f4c483c2e332d2532c44631561ce: Waiting for close lock at 1675861373995Disabling compacts and flushes for region at 1675861373995Disabling writes for close at 1675861373996 (+1 ms)Writing region close event to WAL at 1675861373996Closed at 1675861373996 2023-02-08 13:02:53,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. after waiting 0 ms 2023-02-08 13:02:53,996 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:53,997 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:53,997 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 53392eb0fdd708840594d850c5b02119: Waiting for close lock at 1675861373996Disabling compacts and flushes for region at 1675861373996Disabling writes for close at 1675861373996Writing region close event to WAL at 1675861373996Closed at 1675861373997 (+1 ms) 2023-02-08 13:02:53,997 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 646a3c1c46bd5c27e7bf1e3251adfca3, NAME => 'testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp 2023-02-08 13:02:53,997 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 34ed898d6bc0e38ef76fa255cd47e283, NAME => 'testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp 2023-02-08 13:02:53,998 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:53,998 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 407e898b138d86648b3d6ad809a016b7, disabling compactions & flushes 2023-02-08 13:02:53,998 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:53,998 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:53,998 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. after waiting 0 ms 2023-02-08 13:02:53,998 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:53,998 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:53,998 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 407e898b138d86648b3d6ad809a016b7: Waiting for close lock at 1675861373998Disabling compacts and flushes for region at 1675861373998Disabling writes for close at 1675861373998Writing region close event to WAL at 1675861373998Closed at 1675861373998 2023-02-08 13:02:53,999 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 20c9d781a81b7de50e17d9cfcc362f04, NAME => 'testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp 2023-02-08 13:02:54,026 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,026 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 20c9d781a81b7de50e17d9cfcc362f04, disabling compactions & flushes 2023-02-08 13:02:54,027 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:54,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:54,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. after waiting 0 ms 2023-02-08 13:02:54,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:54,027 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:54,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 20c9d781a81b7de50e17d9cfcc362f04: Waiting for close lock at 1675861374026Disabling compacts and flushes for region at 1675861374026Disabling writes for close at 1675861374027 (+1 ms)Writing region close event to WAL at 1675861374027Closed at 1675861374027 2023-02-08 13:02:54,027 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,028 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,028 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e8458dcff1a335275f5bab3da4be4ba8, NAME => 'testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp 2023-02-08 13:02:54,028 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 646a3c1c46bd5c27e7bf1e3251adfca3, disabling compactions & flushes 2023-02-08 13:02:54,028 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 34ed898d6bc0e38ef76fa255cd47e283, disabling compactions & flushes 2023-02-08 13:02:54,028 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:54,029 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:54,029 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:54,029 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:54,029 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. after waiting 0 ms 2023-02-08 13:02:54,029 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. after waiting 0 ms 2023-02-08 13:02:54,029 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:54,029 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:54,029 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:54,029 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:54,029 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 646a3c1c46bd5c27e7bf1e3251adfca3: Waiting for close lock at 1675861374028Disabling compacts and flushes for region at 1675861374028Disabling writes for close at 1675861374029 (+1 ms)Writing region close event to WAL at 1675861374029Closed at 1675861374029 2023-02-08 13:02:54,030 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 34ed898d6bc0e38ef76fa255cd47e283: Waiting for close lock at 1675861374028Disabling compacts and flushes for region at 1675861374028Disabling writes for close at 1675861374029 (+1 ms)Writing region close event to WAL at 1675861374029Closed at 1675861374029 2023-02-08 13:02:54,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e8458dcff1a335275f5bab3da4be4ba8, disabling compactions & flushes 2023-02-08 13:02:54,045 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:54,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:54,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. after waiting 0 ms 2023-02-08 13:02:54,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:54,045 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:54,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e8458dcff1a335275f5bab3da4be4ba8: Waiting for close lock at 1675861374045Disabling compacts and flushes for region at 1675861374045Disabling writes for close at 1675861374045Writing region close event to WAL at 1675861374045Closed at 1675861374045 2023-02-08 13:02:54,050 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:02:54,052 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861374051"}]},"ts":"1675861374051"} 2023-02-08 13:02:54,052 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861374051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861374051"}]},"ts":"1675861374051"} 2023-02-08 13:02:54,052 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861374051"}]},"ts":"1675861374051"} 2023-02-08 13:02:54,052 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861374051"}]},"ts":"1675861374051"} 2023-02-08 13:02:54,052 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861374051"}]},"ts":"1675861374051"} 2023-02-08 13:02:54,052 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861374051"}]},"ts":"1675861374051"} 2023-02-08 13:02:54,053 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861374051"}]},"ts":"1675861374051"} 2023-02-08 13:02:54,053 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861374051"}]},"ts":"1675861374051"} 2023-02-08 13:02:54,053 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861374051"}]},"ts":"1675861374051"} 2023-02-08 13:02:54,053 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861374051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861374051"}]},"ts":"1675861374051"} 2023-02-08 13:02:54,102 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-08 13:02:54,104 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:02:54,104 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861374104"}]},"ts":"1675861374104"} 2023-02-08 13:02:54,107 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-08 13:02:54,114 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:02:54,126 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:02:54,126 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:02:54,126 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:02:54,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7c6e8f9ce48294c939364df74fd31b84, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4e6088dbda8e673c8279ecc67bbf1b4a, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5dc36048c90a7ebfa122973d7d2b957e, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a999f4c483c2e332d2532c44631561ce, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=53392eb0fdd708840594d850c5b02119, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=407e898b138d86648b3d6ad809a016b7, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=34ed898d6bc0e38ef76fa255cd47e283, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=646a3c1c46bd5c27e7bf1e3251adfca3, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=20c9d781a81b7de50e17d9cfcc362f04, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e8458dcff1a335275f5bab3da4be4ba8, ASSIGN}] 2023-02-08 13:02:54,131 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=34ed898d6bc0e38ef76fa255cd47e283, ASSIGN 2023-02-08 13:02:54,131 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7c6e8f9ce48294c939364df74fd31b84, ASSIGN 2023-02-08 13:02:54,132 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=407e898b138d86648b3d6ad809a016b7, ASSIGN 2023-02-08 13:02:54,132 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=53392eb0fdd708840594d850c5b02119, ASSIGN 2023-02-08 13:02:54,133 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=34ed898d6bc0e38ef76fa255cd47e283, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45759,1675861370954; forceNewPlan=false, retain=false 2023-02-08 13:02:54,136 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7c6e8f9ce48294c939364df74fd31b84, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42029,1675861371000; forceNewPlan=false, retain=false 2023-02-08 13:02:54,136 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=407e898b138d86648b3d6ad809a016b7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42029,1675861371000; forceNewPlan=false, retain=false 2023-02-08 13:02:54,136 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e8458dcff1a335275f5bab3da4be4ba8, ASSIGN 2023-02-08 13:02:54,136 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=53392eb0fdd708840594d850c5b02119, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45759,1675861370954; forceNewPlan=false, retain=false 2023-02-08 13:02:54,136 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=20c9d781a81b7de50e17d9cfcc362f04, ASSIGN 2023-02-08 13:02:54,137 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=646a3c1c46bd5c27e7bf1e3251adfca3, ASSIGN 2023-02-08 13:02:54,137 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a999f4c483c2e332d2532c44631561ce, ASSIGN 2023-02-08 13:02:54,138 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=20c9d781a81b7de50e17d9cfcc362f04, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45759,1675861370954; forceNewPlan=false, retain=false 2023-02-08 13:02:54,138 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5dc36048c90a7ebfa122973d7d2b957e, ASSIGN 2023-02-08 13:02:54,138 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e8458dcff1a335275f5bab3da4be4ba8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42029,1675861371000; forceNewPlan=false, retain=false 2023-02-08 13:02:54,139 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=646a3c1c46bd5c27e7bf1e3251adfca3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42029,1675861371000; forceNewPlan=false, retain=false 2023-02-08 13:02:54,139 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5dc36048c90a7ebfa122973d7d2b957e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45759,1675861370954; forceNewPlan=false, retain=false 2023-02-08 13:02:54,139 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a999f4c483c2e332d2532c44631561ce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42029,1675861371000; forceNewPlan=false, retain=false 2023-02-08 13:02:54,140 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4e6088dbda8e673c8279ecc67bbf1b4a, ASSIGN 2023-02-08 13:02:54,141 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4e6088dbda8e673c8279ecc67bbf1b4a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45759,1675861370954; forceNewPlan=false, retain=false 2023-02-08 13:02:54,195 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:54,195 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:54,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:02:54,283 INFO [jenkins-hbase4:33715] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-08 13:02:54,286 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=53392eb0fdd708840594d850c5b02119, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:54,286 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5dc36048c90a7ebfa122973d7d2b957e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:54,286 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=34ed898d6bc0e38ef76fa255cd47e283, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:54,286 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=20c9d781a81b7de50e17d9cfcc362f04, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:54,287 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374286"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861374286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861374286"}]},"ts":"1675861374286"} 2023-02-08 13:02:54,286 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=4e6088dbda8e673c8279ecc67bbf1b4a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:54,287 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374286"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861374286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861374286"}]},"ts":"1675861374286"} 2023-02-08 13:02:54,287 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374286"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861374286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861374286"}]},"ts":"1675861374286"} 2023-02-08 13:02:54,287 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374286"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861374286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861374286"}]},"ts":"1675861374286"} 2023-02-08 13:02:54,287 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374286"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861374286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861374286"}]},"ts":"1675861374286"} 2023-02-08 13:02:54,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=13, state=RUNNABLE; OpenRegionProcedure 5dc36048c90a7ebfa122973d7d2b957e, server=jenkins-hbase4.apache.org,45759,1675861370954}] 2023-02-08 13:02:54,292 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=17, state=RUNNABLE; OpenRegionProcedure 34ed898d6bc0e38ef76fa255cd47e283, server=jenkins-hbase4.apache.org,45759,1675861370954}] 2023-02-08 13:02:54,294 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure 53392eb0fdd708840594d850c5b02119, server=jenkins-hbase4.apache.org,45759,1675861370954}] 2023-02-08 13:02:54,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=12, state=RUNNABLE; OpenRegionProcedure 4e6088dbda8e673c8279ecc67bbf1b4a, server=jenkins-hbase4.apache.org,45759,1675861370954}] 2023-02-08 13:02:54,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure 20c9d781a81b7de50e17d9cfcc362f04, server=jenkins-hbase4.apache.org,45759,1675861370954}] 2023-02-08 13:02:54,297 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7c6e8f9ce48294c939364df74fd31b84, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:54,298 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861374297"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861374297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861374297"}]},"ts":"1675861374297"} 2023-02-08 13:02:54,298 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=407e898b138d86648b3d6ad809a016b7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:54,299 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374298"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861374298"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861374298"}]},"ts":"1675861374298"} 2023-02-08 13:02:54,300 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=646a3c1c46bd5c27e7bf1e3251adfca3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:54,301 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374300"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861374300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861374300"}]},"ts":"1675861374300"} 2023-02-08 13:02:54,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=11, state=RUNNABLE; OpenRegionProcedure 7c6e8f9ce48294c939364df74fd31b84, server=jenkins-hbase4.apache.org,42029,1675861371000}] 2023-02-08 13:02:54,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=16, state=RUNNABLE; OpenRegionProcedure 407e898b138d86648b3d6ad809a016b7, server=jenkins-hbase4.apache.org,42029,1675861371000}] 2023-02-08 13:02:54,304 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 646a3c1c46bd5c27e7bf1e3251adfca3, server=jenkins-hbase4.apache.org,42029,1675861371000}] 2023-02-08 13:02:54,305 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a999f4c483c2e332d2532c44631561ce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:54,305 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374305"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861374305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861374305"}]},"ts":"1675861374305"} 2023-02-08 13:02:54,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure a999f4c483c2e332d2532c44631561ce, server=jenkins-hbase4.apache.org,42029,1675861371000}] 2023-02-08 13:02:54,308 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e8458dcff1a335275f5bab3da4be4ba8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:54,309 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861374308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861374308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861374308"}]},"ts":"1675861374308"} 2023-02-08 13:02:54,312 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=20, state=RUNNABLE; OpenRegionProcedure e8458dcff1a335275f5bab3da4be4ba8, server=jenkins-hbase4.apache.org,42029,1675861371000}] 2023-02-08 13:02:54,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:54,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5dc36048c90a7ebfa122973d7d2b957e, NAME => 'testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-08 13:02:54,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:02:54,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:02:54,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:02:54,453 INFO [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:02:54,455 DEBUG [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1 2023-02-08 13:02:54,455 DEBUG [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1 2023-02-08 13:02:54,456 INFO [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5dc36048c90a7ebfa122973d7d2b957e columnFamilyName f1 2023-02-08 13:02:54,457 INFO [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] regionserver.HStore(310): Store=5dc36048c90a7ebfa122973d7d2b957e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,457 INFO [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:02:54,460 DEBUG [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2 2023-02-08 13:02:54,460 DEBUG [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2 2023-02-08 13:02:54,461 INFO [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5dc36048c90a7ebfa122973d7d2b957e columnFamilyName f2 2023-02-08 13:02:54,462 INFO [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] regionserver.HStore(310): Store=5dc36048c90a7ebfa122973d7d2b957e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:02:54,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:54,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:02:54,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7c6e8f9ce48294c939364df74fd31b84, NAME => 'testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-08 13:02:54,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:02:54,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:02:54,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:02:54,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:02:54,471 INFO [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:02:54,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:02:54,473 DEBUG [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84/f1 2023-02-08 13:02:54,473 DEBUG [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84/f1 2023-02-08 13:02:54,474 INFO [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c6e8f9ce48294c939364df74fd31b84 columnFamilyName f1 2023-02-08 13:02:54,475 INFO [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] regionserver.HStore(310): Store=7c6e8f9ce48294c939364df74fd31b84/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,475 INFO [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:02:54,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:02:54,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5dc36048c90a7ebfa122973d7d2b957e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59961567, jitterRate=-0.10650302469730377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:02:54,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5dc36048c90a7ebfa122973d7d2b957e: Running coprocessor pre-open hook at 1675861374451Writing region info on filesystem at 1675861374451Initializing all the Stores at 1675861374453 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374453Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374453Cleaning up temporary data from old regions at 1675861374468 (+15 ms)Cleaning up detritus from prior splits at 1675861374469 (+1 ms)Running coprocessor post-open hooks at 1675861374477 (+8 ms)Region opened successfully at 1675861374477 2023-02-08 13:02:54,478 DEBUG [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84/f2 2023-02-08 13:02:54,478 DEBUG [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84/f2 2023-02-08 13:02:54,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e., pid=21, masterSystemTime=1675861374443 2023-02-08 13:02:54,496 INFO [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c6e8f9ce48294c939364df74fd31b84 columnFamilyName f2 2023-02-08 13:02:54,498 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:54,498 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:54,500 INFO [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] regionserver.HStore(310): Store=7c6e8f9ce48294c939364df74fd31b84/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:02:54,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:02:54,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:02:54,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:54,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:54,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:54,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 34ed898d6bc0e38ef76fa255cd47e283, NAME => 'testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-08 13:02:54,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:02:54,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:02:54,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:02:54,507 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5dc36048c90a7ebfa122973d7d2b957e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:54,507 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374507"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861374507"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861374507"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861374507"}]},"ts":"1675861374507"} 2023-02-08 13:02:54,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:02:54,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:02:54,524 INFO [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:02:54,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5dc36048c90a7ebfa122973d7d2b957e, ASSIGN in 399 msec 2023-02-08 13:02:54,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=13 2023-02-08 13:02:54,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=13, state=SUCCESS; OpenRegionProcedure 5dc36048c90a7ebfa122973d7d2b957e, server=jenkins-hbase4.apache.org,45759,1675861370954 in 231 msec 2023-02-08 13:02:54,543 DEBUG [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1 2023-02-08 13:02:54,543 DEBUG [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1 2023-02-08 13:02:54,544 INFO [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34ed898d6bc0e38ef76fa255cd47e283 columnFamilyName f1 2023-02-08 13:02:54,545 INFO [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] regionserver.HStore(310): Store=34ed898d6bc0e38ef76fa255cd47e283/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,545 INFO [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:02:54,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:02:54,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7c6e8f9ce48294c939364df74fd31b84; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74484757, jitterRate=0.10990937054157257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:02:54,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7c6e8f9ce48294c939364df74fd31b84: Running coprocessor pre-open hook at 1675861374468Writing region info on filesystem at 1675861374468Initializing all the Stores at 1675861374469 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374469Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374471 (+2 ms)Cleaning up temporary data from old regions at 1675861374506 (+35 ms)Cleaning up detritus from prior splits at 1675861374507 (+1 ms)Running coprocessor post-open hooks at 1675861374548 (+41 ms)Region opened successfully at 1675861374548 2023-02-08 13:02:54,548 DEBUG [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2 2023-02-08 13:02:54,548 DEBUG [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2 2023-02-08 13:02:54,549 INFO [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34ed898d6bc0e38ef76fa255cd47e283 columnFamilyName f2 2023-02-08 13:02:54,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84., pid=26, masterSystemTime=1675861374458 2023-02-08 13:02:54,550 INFO [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] regionserver.HStore(310): Store=34ed898d6bc0e38ef76fa255cd47e283/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:02:54,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:02:54,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:54,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:54,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:54,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a999f4c483c2e332d2532c44631561ce, NAME => 'testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-08 13:02:54,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a999f4c483c2e332d2532c44631561ce 2023-02-08 13:02:54,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a999f4c483c2e332d2532c44631561ce 2023-02-08 13:02:54,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a999f4c483c2e332d2532c44631561ce 2023-02-08 13:02:54,558 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7c6e8f9ce48294c939364df74fd31b84, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:54,559 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861374558"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861374558"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861374558"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861374558"}]},"ts":"1675861374558"} 2023-02-08 13:02:54,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:02:54,562 INFO [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a999f4c483c2e332d2532c44631561ce 2023-02-08 13:02:54,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:02:54,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=11 2023-02-08 13:02:54,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=11, state=SUCCESS; OpenRegionProcedure 7c6e8f9ce48294c939364df74fd31b84, server=jenkins-hbase4.apache.org,42029,1675861371000 in 260 msec 2023-02-08 13:02:54,567 DEBUG [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1 2023-02-08 13:02:54,567 DEBUG [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1 2023-02-08 13:02:54,567 INFO [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a999f4c483c2e332d2532c44631561ce columnFamilyName f1 2023-02-08 13:02:54,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:02:54,569 INFO [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] regionserver.HStore(310): Store=a999f4c483c2e332d2532c44631561ce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,570 INFO [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a999f4c483c2e332d2532c44631561ce 2023-02-08 13:02:54,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7c6e8f9ce48294c939364df74fd31b84, ASSIGN in 441 msec 2023-02-08 13:02:54,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 34ed898d6bc0e38ef76fa255cd47e283; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68646750, jitterRate=0.022916287183761597}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:02:54,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 34ed898d6bc0e38ef76fa255cd47e283: Running coprocessor pre-open hook at 1675861374507Writing region info on filesystem at 1675861374507Initializing all the Stores at 1675861374509 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374509Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374524 (+15 ms)Cleaning up temporary data from old regions at 1675861374555 (+31 ms)Cleaning up detritus from prior splits at 1675861374556 (+1 ms)Running coprocessor post-open hooks at 1675861374570 (+14 ms)Region opened successfully at 1675861374570 2023-02-08 13:02:54,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283., pid=22, masterSystemTime=1675861374443 2023-02-08 13:02:54,572 DEBUG [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2 2023-02-08 13:02:54,573 DEBUG [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2 2023-02-08 13:02:54,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:54,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:54,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:54,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 53392eb0fdd708840594d850c5b02119, NAME => 'testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-08 13:02:54,575 INFO [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a999f4c483c2e332d2532c44631561ce columnFamilyName f2 2023-02-08 13:02:54,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 53392eb0fdd708840594d850c5b02119 2023-02-08 13:02:54,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,575 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=34ed898d6bc0e38ef76fa255cd47e283, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:54,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 53392eb0fdd708840594d850c5b02119 2023-02-08 13:02:54,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 53392eb0fdd708840594d850c5b02119 2023-02-08 13:02:54,576 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374575"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861374575"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861374575"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861374575"}]},"ts":"1675861374575"} 2023-02-08 13:02:54,576 INFO [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] regionserver.HStore(310): Store=a999f4c483c2e332d2532c44631561ce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,578 INFO [StoreOpener-53392eb0fdd708840594d850c5b02119-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 53392eb0fdd708840594d850c5b02119 2023-02-08 13:02:54,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce 2023-02-08 13:02:54,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce 2023-02-08 13:02:54,580 DEBUG [StoreOpener-53392eb0fdd708840594d850c5b02119-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1 2023-02-08 13:02:54,581 DEBUG [StoreOpener-53392eb0fdd708840594d850c5b02119-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1 2023-02-08 13:02:54,581 INFO [StoreOpener-53392eb0fdd708840594d850c5b02119-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53392eb0fdd708840594d850c5b02119 columnFamilyName f1 2023-02-08 13:02:54,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=17 2023-02-08 13:02:54,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=17, state=SUCCESS; OpenRegionProcedure 34ed898d6bc0e38ef76fa255cd47e283, server=jenkins-hbase4.apache.org,45759,1675861370954 in 288 msec 2023-02-08 13:02:54,585 INFO [StoreOpener-53392eb0fdd708840594d850c5b02119-1] regionserver.HStore(310): Store=53392eb0fdd708840594d850c5b02119/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,586 INFO [StoreOpener-53392eb0fdd708840594d850c5b02119-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 53392eb0fdd708840594d850c5b02119 2023-02-08 13:02:54,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:02:54,588 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=34ed898d6bc0e38ef76fa255cd47e283, ASSIGN in 456 msec 2023-02-08 13:02:54,588 DEBUG [StoreOpener-53392eb0fdd708840594d850c5b02119-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2 2023-02-08 13:02:54,588 DEBUG [StoreOpener-53392eb0fdd708840594d850c5b02119-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2 2023-02-08 13:02:54,589 INFO [StoreOpener-53392eb0fdd708840594d850c5b02119-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53392eb0fdd708840594d850c5b02119 columnFamilyName f2 2023-02-08 13:02:54,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a999f4c483c2e332d2532c44631561ce 2023-02-08 13:02:54,590 INFO [StoreOpener-53392eb0fdd708840594d850c5b02119-1] regionserver.HStore(310): Store=53392eb0fdd708840594d850c5b02119/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119 2023-02-08 13:02:54,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119 2023-02-08 13:02:54,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:02:54,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a999f4c483c2e332d2532c44631561ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65677316, jitterRate=-0.021331727504730225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:02:54,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a999f4c483c2e332d2532c44631561ce: Running coprocessor pre-open hook at 1675861374558Writing region info on filesystem at 1675861374558Initializing all the Stores at 1675861374561 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374561Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374562 (+1 ms)Cleaning up temporary data from old regions at 1675861374580 (+18 ms)Cleaning up detritus from prior splits at 1675861374584 (+4 ms)Running coprocessor post-open hooks at 1675861374594 (+10 ms)Region opened successfully at 1675861374594 2023-02-08 13:02:54,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce., pid=29, masterSystemTime=1675861374458 2023-02-08 13:02:54,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:02:54,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:54,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:54,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:54,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 53392eb0fdd708840594d850c5b02119 2023-02-08 13:02:54,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 407e898b138d86648b3d6ad809a016b7, NAME => 'testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-08 13:02:54,598 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a999f4c483c2e332d2532c44631561ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:54,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 407e898b138d86648b3d6ad809a016b7 2023-02-08 13:02:54,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,599 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374598"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861374598"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861374598"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861374598"}]},"ts":"1675861374598"} 2023-02-08 13:02:54,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 407e898b138d86648b3d6ad809a016b7 2023-02-08 13:02:54,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 407e898b138d86648b3d6ad809a016b7 2023-02-08 13:02:54,602 INFO [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 407e898b138d86648b3d6ad809a016b7 2023-02-08 13:02:54,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:02:54,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 53392eb0fdd708840594d850c5b02119; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67566975, jitterRate=0.006826385855674744}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:02:54,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 53392eb0fdd708840594d850c5b02119: Running coprocessor pre-open hook at 1675861374576Writing region info on filesystem at 1675861374576Initializing all the Stores at 1675861374577 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374577Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374578 (+1 ms)Cleaning up temporary data from old regions at 1675861374594 (+16 ms)Cleaning up detritus from prior splits at 1675861374594Running coprocessor post-open hooks at 1675861374603 (+9 ms)Region opened successfully at 1675861374603 2023-02-08 13:02:54,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119., pid=23, masterSystemTime=1675861374443 2023-02-08 13:02:54,605 DEBUG [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1 2023-02-08 13:02:54,605 DEBUG [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1 2023-02-08 13:02:54,606 INFO [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 407e898b138d86648b3d6ad809a016b7 columnFamilyName f1 2023-02-08 13:02:54,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:54,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:54,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:54,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-08 13:02:54,607 INFO [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] regionserver.HStore(310): Store=407e898b138d86648b3d6ad809a016b7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 20c9d781a81b7de50e17d9cfcc362f04, NAME => 'testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-08 13:02:54,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure a999f4c483c2e332d2532c44631561ce, server=jenkins-hbase4.apache.org,42029,1675861371000 in 294 msec 2023-02-08 13:02:54,608 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=53392eb0fdd708840594d850c5b02119, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:54,608 INFO [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 407e898b138d86648b3d6ad809a016b7 2023-02-08 13:02:54,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:02:54,608 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861374608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861374608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861374608"}]},"ts":"1675861374608"} 2023-02-08 13:02:54,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:02:54,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:02:54,610 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a999f4c483c2e332d2532c44631561ce, ASSIGN in 481 msec 2023-02-08 13:02:54,611 DEBUG [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2 2023-02-08 13:02:54,611 INFO [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:02:54,611 DEBUG [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2 2023-02-08 13:02:54,644 INFO [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 407e898b138d86648b3d6ad809a016b7 columnFamilyName f2 2023-02-08 13:02:54,645 INFO [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] regionserver.HStore(310): Store=407e898b138d86648b3d6ad809a016b7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,648 DEBUG [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1 2023-02-08 13:02:54,648 DEBUG [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1 2023-02-08 13:02:54,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-08 13:02:54,649 INFO [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20c9d781a81b7de50e17d9cfcc362f04 columnFamilyName f1 2023-02-08 13:02:54,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7 2023-02-08 13:02:54,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure 53392eb0fdd708840594d850c5b02119, server=jenkins-hbase4.apache.org,45759,1675861370954 in 317 msec 2023-02-08 13:02:54,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7 2023-02-08 13:02:54,650 INFO [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] regionserver.HStore(310): Store=20c9d781a81b7de50e17d9cfcc362f04/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,650 INFO [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:02:54,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=53392eb0fdd708840594d850c5b02119, ASSIGN in 523 msec 2023-02-08 13:02:54,653 DEBUG [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2 2023-02-08 13:02:54,653 DEBUG [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2 2023-02-08 13:02:54,653 INFO [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20c9d781a81b7de50e17d9cfcc362f04 columnFamilyName f2 2023-02-08 13:02:54,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:02:54,654 INFO [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] regionserver.HStore(310): Store=20c9d781a81b7de50e17d9cfcc362f04/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:02:54,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:02:54,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 407e898b138d86648b3d6ad809a016b7 2023-02-08 13:02:54,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:02:54,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:02:54,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:02:54,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 407e898b138d86648b3d6ad809a016b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69352647, jitterRate=0.033434972167015076}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:02:54,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 407e898b138d86648b3d6ad809a016b7: Running coprocessor pre-open hook at 1675861374599Writing region info on filesystem at 1675861374599Initializing all the Stores at 1675861374601 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374601Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374602 (+1 ms)Cleaning up temporary data from old regions at 1675861374651 (+49 ms)Cleaning up detritus from prior splits at 1675861374652 (+1 ms)Running coprocessor post-open hooks at 1675861374664 (+12 ms)Region opened successfully at 1675861374664 2023-02-08 13:02:54,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7., pid=27, masterSystemTime=1675861374458 2023-02-08 13:02:54,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:02:54,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 20c9d781a81b7de50e17d9cfcc362f04; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66274286, jitterRate=-0.01243618130683899}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:02:54,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 20c9d781a81b7de50e17d9cfcc362f04: Running coprocessor pre-open hook at 1675861374609Writing region info on filesystem at 1675861374609Initializing all the Stores at 1675861374611 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374611Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374611Cleaning up temporary data from old regions at 1675861374658 (+47 ms)Cleaning up detritus from prior splits at 1675861374658Running coprocessor post-open hooks at 1675861374667 (+9 ms)Region opened successfully at 1675861374667 2023-02-08 13:02:54,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:54,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04., pid=25, masterSystemTime=1675861374443 2023-02-08 13:02:54,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:54,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:54,669 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=407e898b138d86648b3d6ad809a016b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:54,669 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374669"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861374669"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861374669"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861374669"}]},"ts":"1675861374669"} 2023-02-08 13:02:54,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 646a3c1c46bd5c27e7bf1e3251adfca3, NAME => 'testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-08 13:02:54,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:02:54,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:54,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:54,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:54,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4e6088dbda8e673c8279ecc67bbf1b4a, NAME => 'testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-08 13:02:54,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:02:54,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:02:54,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:02:54,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:02:54,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:02:54,673 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=20c9d781a81b7de50e17d9cfcc362f04, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:54,674 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374673"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861374673"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861374673"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861374673"}]},"ts":"1675861374673"} 2023-02-08 13:02:54,678 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=16 2023-02-08 13:02:54,678 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=16, state=SUCCESS; OpenRegionProcedure 407e898b138d86648b3d6ad809a016b7, server=jenkins-hbase4.apache.org,42029,1675861371000 in 371 msec 2023-02-08 13:02:54,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-08 13:02:54,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure 20c9d781a81b7de50e17d9cfcc362f04, server=jenkins-hbase4.apache.org,45759,1675861370954 in 379 msec 2023-02-08 13:02:54,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=407e898b138d86648b3d6ad809a016b7, ASSIGN in 552 msec 2023-02-08 13:02:54,681 INFO [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:02:54,681 INFO [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:02:54,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=20c9d781a81b7de50e17d9cfcc362f04, ASSIGN in 554 msec 2023-02-08 13:02:54,683 DEBUG [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1 2023-02-08 13:02:54,683 DEBUG [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1 2023-02-08 13:02:54,683 DEBUG [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1 2023-02-08 13:02:54,683 DEBUG [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1 2023-02-08 13:02:54,684 INFO [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 646a3c1c46bd5c27e7bf1e3251adfca3 columnFamilyName f1 2023-02-08 13:02:54,684 INFO [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e6088dbda8e673c8279ecc67bbf1b4a columnFamilyName f1 2023-02-08 13:02:54,684 INFO [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] regionserver.HStore(310): Store=646a3c1c46bd5c27e7bf1e3251adfca3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,685 INFO [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:02:54,686 DEBUG [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2 2023-02-08 13:02:54,686 DEBUG [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2 2023-02-08 13:02:54,687 INFO [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 646a3c1c46bd5c27e7bf1e3251adfca3 columnFamilyName f2 2023-02-08 13:02:54,688 INFO [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] regionserver.HStore(310): Store=646a3c1c46bd5c27e7bf1e3251adfca3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,688 INFO [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] regionserver.HStore(310): Store=4e6088dbda8e673c8279ecc67bbf1b4a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,689 INFO [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:02:54,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:02:54,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:02:54,691 DEBUG [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2 2023-02-08 13:02:54,691 DEBUG [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2 2023-02-08 13:02:54,691 INFO [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e6088dbda8e673c8279ecc67bbf1b4a columnFamilyName f2 2023-02-08 13:02:54,692 INFO [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] regionserver.HStore(310): Store=4e6088dbda8e673c8279ecc67bbf1b4a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:02:54,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:02:54,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:02:54,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:02:54,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:02:54,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:02:54,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:02:54,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 646a3c1c46bd5c27e7bf1e3251adfca3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65716061, jitterRate=-0.020754382014274597}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:02:54,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 646a3c1c46bd5c27e7bf1e3251adfca3: Running coprocessor pre-open hook at 1675861374674Writing region info on filesystem at 1675861374674Initializing all the Stores at 1675861374675 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374675Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374681 (+6 ms)Cleaning up temporary data from old regions at 1675861374691 (+10 ms)Cleaning up detritus from prior splits at 1675861374692 (+1 ms)Running coprocessor post-open hooks at 1675861374699 (+7 ms)Region opened successfully at 1675861374699 2023-02-08 13:02:54,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3., pid=28, masterSystemTime=1675861374458 2023-02-08 13:02:54,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:02:54,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4e6088dbda8e673c8279ecc67bbf1b4a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65709952, jitterRate=-0.020845413208007812}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:02:54,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4e6088dbda8e673c8279ecc67bbf1b4a: Running coprocessor pre-open hook at 1675861374673Writing region info on filesystem at 1675861374673Initializing all the Stores at 1675861374674 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374674Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374681 (+7 ms)Cleaning up temporary data from old regions at 1675861374696 (+15 ms)Cleaning up detritus from prior splits at 1675861374696Running coprocessor post-open hooks at 1675861374703 (+7 ms)Region opened successfully at 1675861374703 2023-02-08 13:02:54,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:54,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:54,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:54,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e8458dcff1a335275f5bab3da4be4ba8, NAME => 'testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-08 13:02:54,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a., pid=24, masterSystemTime=1675861374443 2023-02-08 13:02:54,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:02:54,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:54,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:02:54,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:02:54,704 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=646a3c1c46bd5c27e7bf1e3251adfca3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:54,705 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374704"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861374704"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861374704"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861374704"}]},"ts":"1675861374704"} 2023-02-08 13:02:54,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:54,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:54,708 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=4e6088dbda8e673c8279ecc67bbf1b4a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:54,708 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861374708"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861374708"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861374708"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861374708"}]},"ts":"1675861374708"} 2023-02-08 13:02:54,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-08 13:02:54,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 646a3c1c46bd5c27e7bf1e3251adfca3, server=jenkins-hbase4.apache.org,42029,1675861371000 in 404 msec 2023-02-08 13:02:54,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=646a3c1c46bd5c27e7bf1e3251adfca3, ASSIGN in 586 msec 2023-02-08 13:02:54,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=12 2023-02-08 13:02:54,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=12, state=SUCCESS; OpenRegionProcedure 4e6088dbda8e673c8279ecc67bbf1b4a, server=jenkins-hbase4.apache.org,45759,1675861370954 in 416 msec 2023-02-08 13:02:54,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4e6088dbda8e673c8279ecc67bbf1b4a, ASSIGN in 588 msec 2023-02-08 13:02:54,720 INFO [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:02:54,722 DEBUG [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8/f1 2023-02-08 13:02:54,722 DEBUG [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8/f1 2023-02-08 13:02:54,723 INFO [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8458dcff1a335275f5bab3da4be4ba8 columnFamilyName f1 2023-02-08 13:02:54,724 INFO [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] regionserver.HStore(310): Store=e8458dcff1a335275f5bab3da4be4ba8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,724 INFO [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:02:54,726 DEBUG [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8/f2 2023-02-08 13:02:54,726 DEBUG [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8/f2 2023-02-08 13:02:54,727 INFO [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8458dcff1a335275f5bab3da4be4ba8 columnFamilyName f2 2023-02-08 13:02:54,727 INFO [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] regionserver.HStore(310): Store=e8458dcff1a335275f5bab3da4be4ba8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:54,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:02:54,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:02:54,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:02:54,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:02:54,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:02:54,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e8458dcff1a335275f5bab3da4be4ba8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63024592, jitterRate=-0.060860395431518555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:02:54,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e8458dcff1a335275f5bab3da4be4ba8: Running coprocessor pre-open hook at 1675861374704Writing region info on filesystem at 1675861374704Initializing all the Stores at 1675861374706 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374706Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861374720 (+14 ms)Cleaning up temporary data from old regions at 1675861374731 (+11 ms)Cleaning up detritus from prior splits at 1675861374731Running coprocessor post-open hooks at 1675861374737 (+6 ms)Region opened successfully at 1675861374738 (+1 ms) 2023-02-08 13:02:54,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8., pid=30, masterSystemTime=1675861374458 2023-02-08 13:02:54,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:54,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:54,742 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e8458dcff1a335275f5bab3da4be4ba8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:54,742 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861374742"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861374742"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861374742"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861374742"}]},"ts":"1675861374742"} 2023-02-08 13:02:54,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=20 2023-02-08 13:02:54,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=20, state=SUCCESS; OpenRegionProcedure e8458dcff1a335275f5bab3da4be4ba8, server=jenkins-hbase4.apache.org,42029,1675861371000 in 433 msec 2023-02-08 13:02:54,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=10 2023-02-08 13:02:54,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e8458dcff1a335275f5bab3da4be4ba8, ASSIGN in 621 msec 2023-02-08 13:02:54,752 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:02:54,752 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861374752"}]},"ts":"1675861374752"} 2023-02-08 13:02:54,754 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-08 13:02:54,757 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:02:54,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 899 msec 2023-02-08 13:02:55,002 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:55,002 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:55,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:02:55,005 INFO [Listener at localhost/41037] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-08 13:02:55,006 DEBUG [Listener at localhost/41037] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-08 13:02:55,008 INFO [Listener at localhost/41037] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:02:55,034 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-08 13:02:55,035 INFO [Listener at localhost/41037] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:02:55,035 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-08 13:02:55,035 INFO [Listener at localhost/41037] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 13:02:55,183 DEBUG [hconnection-0x254e1275-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:02:55,239 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50168, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:02:55,264 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42029] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:55,270 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45759] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:55,611 INFO [Listener at localhost/41037] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 13:02:55,615 INFO [Listener at localhost/41037] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 13:02:55,627 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:55,627 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:55,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 13:02:55,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675861375631 (current time:1675861375631). 2023-02-08 13:02:55,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 13:02:55,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] zookeeper.ReadOnlyZKClient(139): Connect 0x290b83bd to 127.0.0.1:64435 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:02:55,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@674e5824, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:02:55,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:02:55,651 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43384, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:02:55,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x290b83bd to 127.0.0.1:64435 2023-02-08 13:02:55,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:02:55,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 13:02:55,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 13:02:55,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 13:02:55,683 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 13:02:55,685 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675861975685 2023-02-08 13:02:55,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 13:02:55,686 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-08 13:02:55,691 DEBUG [Listener at localhost/41037] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 13:02:55,691 DEBUG [Listener at localhost/41037] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 13:02:55,693 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 13:02:55,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 13:02:55,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 21 msec 2023-02-08 13:02:55,696 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 13:02:55,697 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675861975697 2023-02-08 13:02:55,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-08 13:02:55,727 INFO [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-08 13:02:55,727 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:02:55,727 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-08 13:02:55,727 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-08 13:02:55,728 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:55,728 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 13:02:55,731 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:02:55,731 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:02:55,731 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:55,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:02:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:02:55,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:02:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:02:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 13:02:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 13:02:55,732 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:55,732 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:55,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:55,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:55,733 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:55,733 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:02:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-08 13:02:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 13:02:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-08 13:02:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 13:02:55,733 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-08 13:02:55,733 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-08 13:02:55,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-08 13:02:55,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-08 13:02:55,737 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-08 13:02:55,737 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-08 13:02:55,737 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:02:55,737 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:02:55,738 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-08 13:02:55,738 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-08 13:02:55,738 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42029,1675861371000' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-08 13:02:55,738 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-08 13:02:55,739 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-08 13:02:55,739 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45759,1675861370954' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-08 13:02:55,741 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 13:02:55,741 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 13:02:55,741 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:55,741 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:02:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:02:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 13:02:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:02:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 13:02:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:02:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:02:55,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:02:55,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 13:02:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:02:55,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45759,1675861370954' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-08 13:02:55,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a8fd64a[Count = 1] remaining members to acquire global barrier 2023-02-08 13:02:55,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:55,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:02:55,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:02:55,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:02:55,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:02:55,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 13:02:55,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:55,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:55,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:02:55,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42029,1675861371000' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-08 13:02:55,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a8fd64a[Count = 0] remaining members to acquire global barrier 2023-02-08 13:02:55,748 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-08 13:02:55,748 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 13:02:55,750 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 13:02:55,750 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 13:02:55,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 13:02:55,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 13:02:55,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 13:02:55,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 13:02:55,750 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-08 13:02:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-08 13:02:55,751 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:55,751 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:02:55,751 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:55,752 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. started... 2023-02-08 13:02:55,753 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] regionserver.HRegion(2744): Flushing a999f4c483c2e332d2532c44631561ce 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:02:55,754 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:55,754 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:55,754 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. started... 2023-02-08 13:02:55,754 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-08 13:02:55,754 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. started... 2023-02-08 13:02:55,754 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. started... 2023-02-08 13:02:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 13:02:55,754 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:55,762 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5dc36048c90a7ebfa122973d7d2b957e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:02:55,762 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-08 13:02:55,762 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:55,764 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. started... 2023-02-08 13:02:55,764 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 13:02:55,764 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. started... 2023-02-08 13:02:55,765 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 4e6088dbda8e673c8279ecc67bbf1b4a 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-08 13:02:55,765 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 20c9d781a81b7de50e17d9cfcc362f04 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-08 13:02:55,766 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7c6e8f9ce48294c939364df74fd31b84: 2023-02-08 13:02:55,766 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e8458dcff1a335275f5bab3da4be4ba8: 2023-02-08 13:02:55,767 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:55,767 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:55,772 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:02:55,772 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:02:55,777 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 13:02:55,777 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 13:02:55,777 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 13:02:55,777 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 13:02:55,792 DEBUG [Listener at localhost/41037] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:02:55,792 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:55,792 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:55,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 13:02:55,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:02:55,798 DEBUG [Listener at localhost/41037] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 13:02:55,825 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. completed. 2023-02-08 13:02:55,826 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:55,827 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:55,827 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-08 13:02:55,827 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. started... 2023-02-08 13:02:55,828 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 407e898b138d86648b3d6ad809a016b7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:02:55,954 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/.tmp/f1/fcd241950ddb4edaaf1ca20d1bce234e 2023-02-08 13:02:55,998 DEBUG [Listener at localhost/41037] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:02:55,998 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:55,998 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:56,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 13:02:56,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:02:56,004 DEBUG [Listener at localhost/41037] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-08 13:02:56,005 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/.tmp/f1/c19037465ce9483dabc0ee14319f7d6d 2023-02-08 13:02:56,008 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/.tmp/f1/75bd0c5ff5504e39b20aa5f05d728b85 2023-02-08 13:02:56,009 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/.tmp/f1/ec0a53e2598f4a1888bedfe3182dcf65 2023-02-08 13:02:56,010 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/.tmp/f1/f06814bdc27c43ab802ac0786229f47c 2023-02-08 13:02:56,118 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/.tmp/f2/c5ba6263294a410186948d443da0ac57 2023-02-08 13:02:56,136 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/.tmp/f2/d763cb9566ff475e9bc84ff01992c579 2023-02-08 13:02:56,156 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/.tmp/f2/520e615c81e74caf9750901c7cc8a4e7 2023-02-08 13:02:56,160 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/.tmp/f1/ec0a53e2598f4a1888bedfe3182dcf65 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1/ec0a53e2598f4a1888bedfe3182dcf65 2023-02-08 13:02:56,164 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/.tmp/f1/fcd241950ddb4edaaf1ca20d1bce234e as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1/fcd241950ddb4edaaf1ca20d1bce234e 2023-02-08 13:02:56,169 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/.tmp/f1/75bd0c5ff5504e39b20aa5f05d728b85 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1/75bd0c5ff5504e39b20aa5f05d728b85 2023-02-08 13:02:56,174 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1/ec0a53e2598f4a1888bedfe3182dcf65, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 13:02:56,177 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/.tmp/f2/c5ba6263294a410186948d443da0ac57 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2/c5ba6263294a410186948d443da0ac57 2023-02-08 13:02:56,182 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1/75bd0c5ff5504e39b20aa5f05d728b85, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:02:56,184 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/.tmp/f2/520e615c81e74caf9750901c7cc8a4e7 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2/520e615c81e74caf9750901c7cc8a4e7 2023-02-08 13:02:56,185 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1/fcd241950ddb4edaaf1ca20d1bce234e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 13:02:56,186 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/.tmp/f2/d763cb9566ff475e9bc84ff01992c579 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2/d763cb9566ff475e9bc84ff01992c579 2023-02-08 13:02:56,188 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2/c5ba6263294a410186948d443da0ac57, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 13:02:56,190 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 4e6088dbda8e673c8279ecc67bbf1b4a in 425ms, sequenceid=5, compaction requested=false 2023-02-08 13:02:56,192 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-08 13:02:56,194 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4e6088dbda8e673c8279ecc67bbf1b4a: 2023-02-08 13:02:56,194 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,194 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:02:56,194 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1/ec0a53e2598f4a1888bedfe3182dcf65] hfiles 2023-02-08 13:02:56,194 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1/ec0a53e2598f4a1888bedfe3182dcf65 for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,195 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2/520e615c81e74caf9750901c7cc8a4e7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:02:56,196 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2/d763cb9566ff475e9bc84ff01992c579, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 13:02:56,196 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a999f4c483c2e332d2532c44631561ce in 443ms, sequenceid=5, compaction requested=false 2023-02-08 13:02:56,197 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a999f4c483c2e332d2532c44631561ce: 2023-02-08 13:02:56,197 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,197 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:02:56,197 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1/75bd0c5ff5504e39b20aa5f05d728b85] hfiles 2023-02-08 13:02:56,198 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1/75bd0c5ff5504e39b20aa5f05d728b85 for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,198 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 20c9d781a81b7de50e17d9cfcc362f04 in 432ms, sequenceid=5, compaction requested=false 2023-02-08 13:02:56,198 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 20c9d781a81b7de50e17d9cfcc362f04: 2023-02-08 13:02:56,198 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,198 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:02:56,198 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1/fcd241950ddb4edaaf1ca20d1bce234e] hfiles 2023-02-08 13:02:56,198 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1/fcd241950ddb4edaaf1ca20d1bce234e for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,200 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2/c5ba6263294a410186948d443da0ac57] hfiles 2023-02-08 13:02:56,200 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2/d763cb9566ff475e9bc84ff01992c579] hfiles 2023-02-08 13:02:56,200 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2/520e615c81e74caf9750901c7cc8a4e7] hfiles 2023-02-08 13:02:56,200 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2/d763cb9566ff475e9bc84ff01992c579 for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,200 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2/c5ba6263294a410186948d443da0ac57 for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,200 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2/520e615c81e74caf9750901c7cc8a4e7 for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,231 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. completed. 2023-02-08 13:02:56,231 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:56,232 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:56,232 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-08 13:02:56,232 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. started... 2023-02-08 13:02:56,233 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 646a3c1c46bd5c27e7bf1e3251adfca3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:02:56,234 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. completed. 2023-02-08 13:02:56,234 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:56,234 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-08 13:02:56,234 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. completed. 2023-02-08 13:02:56,234 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:56,235 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:56,235 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-08 13:02:56,235 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. started... 2023-02-08 13:02:56,235 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. completed. 2023-02-08 13:02:56,235 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 34ed898d6bc0e38ef76fa255cd47e283 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:02:56,235 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:56,236 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:56,236 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-08 13:02:56,236 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. started... 2023-02-08 13:02:56,237 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 53392eb0fdd708840594d850c5b02119 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:02:56,280 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/.tmp/f1/5e48cf6c7d5746f1a7b2d7f766ba8bc8 2023-02-08 13:02:56,290 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/.tmp/f1/da4a663f488947d2b8100ca5604f17a5 2023-02-08 13:02:56,296 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/.tmp/f1/88056020e3d24ae0b2b65116285eb2a2 2023-02-08 13:02:56,305 DEBUG [Listener at localhost/41037] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:02:56,305 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:56,305 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:56,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 13:02:56,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:02:56,308 DEBUG [Listener at localhost/41037] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-08 13:02:56,320 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/.tmp/f2/4365f72439254dc68c93f7104c850c40 2023-02-08 13:02:56,331 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/.tmp/f1/5e48cf6c7d5746f1a7b2d7f766ba8bc8 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1/5e48cf6c7d5746f1a7b2d7f766ba8bc8 2023-02-08 13:02:56,334 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/.tmp/f2/99df961875964972ba3f812eb3407032 2023-02-08 13:02:56,335 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/.tmp/f2/e23a88fadc3447878ceb5de90642291e 2023-02-08 13:02:56,347 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/.tmp/f1/da4a663f488947d2b8100ca5604f17a5 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1/da4a663f488947d2b8100ca5604f17a5 2023-02-08 13:02:56,350 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/.tmp/f1/88056020e3d24ae0b2b65116285eb2a2 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1/88056020e3d24ae0b2b65116285eb2a2 2023-02-08 13:02:56,352 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1/5e48cf6c7d5746f1a7b2d7f766ba8bc8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:02:56,353 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/.tmp/f2/4365f72439254dc68c93f7104c850c40 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2/4365f72439254dc68c93f7104c850c40 2023-02-08 13:02:56,363 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2/4365f72439254dc68c93f7104c850c40, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:02:56,365 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 646a3c1c46bd5c27e7bf1e3251adfca3 in 131ms, sequenceid=5, compaction requested=false 2023-02-08 13:02:56,366 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 646a3c1c46bd5c27e7bf1e3251adfca3: 2023-02-08 13:02:56,366 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,366 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:02:56,366 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1/5e48cf6c7d5746f1a7b2d7f766ba8bc8] hfiles 2023-02-08 13:02:56,366 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1/5e48cf6c7d5746f1a7b2d7f766ba8bc8 for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,366 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2/4365f72439254dc68c93f7104c850c40] hfiles 2023-02-08 13:02:56,366 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2/4365f72439254dc68c93f7104c850c40 for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,367 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1/da4a663f488947d2b8100ca5604f17a5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:02:56,367 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1/88056020e3d24ae0b2b65116285eb2a2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:02:56,368 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/.tmp/f2/99df961875964972ba3f812eb3407032 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2/99df961875964972ba3f812eb3407032 2023-02-08 13:02:56,368 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/.tmp/f2/e23a88fadc3447878ceb5de90642291e as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2/e23a88fadc3447878ceb5de90642291e 2023-02-08 13:02:56,377 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2/99df961875964972ba3f812eb3407032, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:02:56,378 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2/e23a88fadc3447878ceb5de90642291e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:02:56,378 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 34ed898d6bc0e38ef76fa255cd47e283 in 143ms, sequenceid=5, compaction requested=false 2023-02-08 13:02:56,378 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 34ed898d6bc0e38ef76fa255cd47e283: 2023-02-08 13:02:56,379 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,379 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:02:56,379 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1/da4a663f488947d2b8100ca5604f17a5] hfiles 2023-02-08 13:02:56,379 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1/da4a663f488947d2b8100ca5604f17a5 for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,379 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 53392eb0fdd708840594d850c5b02119 in 143ms, sequenceid=5, compaction requested=false 2023-02-08 13:02:56,379 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2/99df961875964972ba3f812eb3407032] hfiles 2023-02-08 13:02:56,379 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 53392eb0fdd708840594d850c5b02119: 2023-02-08 13:02:56,379 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2/99df961875964972ba3f812eb3407032 for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,379 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,379 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:02:56,379 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1/88056020e3d24ae0b2b65116285eb2a2] hfiles 2023-02-08 13:02:56,380 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1/88056020e3d24ae0b2b65116285eb2a2 for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,380 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2/e23a88fadc3447878ceb5de90642291e] hfiles 2023-02-08 13:02:56,380 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2/e23a88fadc3447878ceb5de90642291e for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,383 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. completed. 2023-02-08 13:02:56,384 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:56,384 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-08 13:02:56,420 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. completed. 2023-02-08 13:02:56,420 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:56,420 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-08 13:02:56,422 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. completed. 2023-02-08 13:02:56,422 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:56,422 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-08 13:02:56,556 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/.tmp/f2/6d7cb531319144d79eb17784213e3289 2023-02-08 13:02:56,557 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/.tmp/f2/98deec41e5aa4834a00c8934b0f882ba 2023-02-08 13:02:56,565 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/.tmp/f1/f06814bdc27c43ab802ac0786229f47c as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1/f06814bdc27c43ab802ac0786229f47c 2023-02-08 13:02:56,566 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/.tmp/f1/c19037465ce9483dabc0ee14319f7d6d as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1/c19037465ce9483dabc0ee14319f7d6d 2023-02-08 13:02:56,574 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1/f06814bdc27c43ab802ac0786229f47c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:02:56,574 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1/c19037465ce9483dabc0ee14319f7d6d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:02:56,575 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/.tmp/f2/98deec41e5aa4834a00c8934b0f882ba as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2/98deec41e5aa4834a00c8934b0f882ba 2023-02-08 13:02:56,575 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/.tmp/f2/6d7cb531319144d79eb17784213e3289 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2/6d7cb531319144d79eb17784213e3289 2023-02-08 13:02:56,585 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2/98deec41e5aa4834a00c8934b0f882ba, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:02:56,586 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2/6d7cb531319144d79eb17784213e3289, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:02:56,587 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 407e898b138d86648b3d6ad809a016b7 in 759ms, sequenceid=5, compaction requested=false 2023-02-08 13:02:56,587 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 407e898b138d86648b3d6ad809a016b7: 2023-02-08 13:02:56,587 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,588 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5dc36048c90a7ebfa122973d7d2b957e in 825ms, sequenceid=5, compaction requested=false 2023-02-08 13:02:56,588 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:02:56,588 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1/f06814bdc27c43ab802ac0786229f47c] hfiles 2023-02-08 13:02:56,588 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1/f06814bdc27c43ab802ac0786229f47c for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,588 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2/98deec41e5aa4834a00c8934b0f882ba] hfiles 2023-02-08 13:02:56,588 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2/98deec41e5aa4834a00c8934b0f882ba for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,588 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5dc36048c90a7ebfa122973d7d2b957e: 2023-02-08 13:02:56,588 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,588 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:02:56,588 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1/c19037465ce9483dabc0ee14319f7d6d] hfiles 2023-02-08 13:02:56,589 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1/c19037465ce9483dabc0ee14319f7d6d for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,589 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2/6d7cb531319144d79eb17784213e3289] hfiles 2023-02-08 13:02:56,589 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2/6d7cb531319144d79eb17784213e3289 for snapshot=testWithMapReduceMultiRegion 2023-02-08 13:02:56,601 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. completed. 2023-02-08 13:02:56,601 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:56,601 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-08 13:02:56,601 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-08 13:02:56,601 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. completed. 2023-02-08 13:02:56,601 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:56,601 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:56,601 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-08 13:02:56,601 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-08 13:02:56,601 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-08 13:02:56,602 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42029,1675861371000' in zk 2023-02-08 13:02:56,602 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:56,602 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-08 13:02:56,602 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,45759,1675861370954' in zk 2023-02-08 13:02:56,605 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-08 13:02:56,605 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:56,605 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:02:56,605 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:56,605 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-08 13:02:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:02:56,605 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-08 13:02:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:02:56,606 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:02:56,606 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-08 13:02:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:02:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:02:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 13:02:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:02:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 13:02:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,45759,1675861370954': 2023-02-08 13:02:56,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45759,1675861370954' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-08 13:02:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:02:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:02:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:02:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:02:56,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 13:02:56,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:02:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 13:02:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42029,1675861371000': 2023-02-08 13:02:56,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42029,1675861371000' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-08 13:02:56,615 INFO [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-08 13:02:56,615 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:02:56,615 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:02:56,615 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-08 13:02:56,615 INFO [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 13:02:56,618 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:56,618 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:56,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:56,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:56,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:56,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:02:56,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:02:56,618 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:02:56,618 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:56,619 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:02:56,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:56,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:56,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:02:56,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:02:56,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:02:56,619 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:56,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:02:56,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:02:56,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:56,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:56,620 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:56,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 13:02:56,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:02:56,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 13:02:56,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:56,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:56,623 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:56,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:02:56,623 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:56,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-08 13:02:56,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:56,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:56,642 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:56,642 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:02:56,642 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:02:56,642 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 13:02:56,642 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:56,642 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-08 13:02:56,642 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:56,642 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 13:02:56,642 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:56,642 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-08 13:02:56,642 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-08 13:02:56,642 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-08 13:02:56,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:02:56,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:02:56,642 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:02:56,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-08 13:02:56,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:02:56,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:02:56,642 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:02:56,642 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:02:56,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:02:56,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:02:56,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:02:56,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:02:56,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-08 13:02:56,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-08 13:02:56,800 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-08 13:02:56,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-08 13:02:56,801 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-08 13:02:56,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675861375686Consolidate snapshot: testWithMapReduceMultiRegion at 1675861376642 (+956 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1675861376643 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1675861376680 (+37 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1675861376699 (+19 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1675861376800 (+101 ms) 2023-02-08 13:02:56,802 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 13:02:56,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1120 sec 2023-02-08 13:02:56,808 DEBUG [Listener at localhost/41037] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:02:56,808 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:56,808 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:56,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 13:02:56,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 13:02:56,810 INFO [Listener at localhost/41037] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 13:02:56,811 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:56,811 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:56,823 INFO [Listener at localhost/41037] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 13:02:56,839 INFO [Listener at localhost/41037] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 13:02:56,910 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42029] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:56,927 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45759] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:57,106 INFO [Listener at localhost/41037] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 13:02:57,120 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:57,120 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:57,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 13:02:57,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-08 13:02:57,134 INFO [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-08 13:02:57,134 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:02:57,135 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-08 13:02:57,135 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-08 13:02:57,136 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:57,136 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:02:57,137 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:02:57,137 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:02:57,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:02:57,137 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:57,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:02:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:02:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:02:57,138 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:57,138 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:02:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:02:57,139 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:57,139 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:02:57,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:57,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:57,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:02:57,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:02:57,139 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-08 13:02:57,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:02:57,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:02:57,140 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-08 13:02:57,141 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-08 13:02:57,141 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-08 13:02:57,142 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-08 13:02:57,142 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:02:57,142 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-08 13:02:57,143 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-08 13:02:57,143 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:02:57,144 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-08 13:02:57,148 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:57,148 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. started... 2023-02-08 13:02:57,148 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5dc36048c90a7ebfa122973d7d2b957e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:02:57,148 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:57,148 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. started... 2023-02-08 13:02:57,148 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:57,149 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a999f4c483c2e332d2532c44631561ce 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:02:57,149 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. started... 2023-02-08 13:02:57,149 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7c6e8f9ce48294c939364df74fd31b84: 2023-02-08 13:02:57,149 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-08 13:02:57,149 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 13:02:57,149 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:57,149 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. started... 2023-02-08 13:02:57,150 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e8458dcff1a335275f5bab3da4be4ba8: 2023-02-08 13:02:57,150 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:57,149 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:57,156 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:57,157 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. started... 2023-02-08 13:02:57,150 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-08 13:02:57,150 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:57,160 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 646a3c1c46bd5c27e7bf1e3251adfca3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:02:57,160 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-08 13:02:57,160 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:57,160 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-08 13:02:57,161 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. started... 2023-02-08 13:02:57,157 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:57,161 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. started... 2023-02-08 13:02:57,161 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4e6088dbda8e673c8279ecc67bbf1b4a 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-08 13:02:57,161 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 20c9d781a81b7de50e17d9cfcc362f04 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-08 13:02:57,161 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 13:02:57,160 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. started... 2023-02-08 13:02:57,162 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 407e898b138d86648b3d6ad809a016b7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:02:57,296 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/.tmp/f1/4905b1d7fd78479cac3fdd7918fd2e25 2023-02-08 13:02:57,297 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/.tmp/f1/ef8a293675fb42bca6cc8eb4e558b89f 2023-02-08 13:02:57,332 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/.tmp/f1/fe9c6d6920ac4be280a86ab514a17028 2023-02-08 13:02:57,383 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/.tmp/f1/a01d6dc41f7745c4810d7a4e46c0efc3 2023-02-08 13:02:57,384 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/.tmp/f1/ab70648fd9c24b7bb875989da8a507b7 2023-02-08 13:02:57,408 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/.tmp/f2/0b6ea65d235e41e492246b8a4cd24ef3 2023-02-08 13:02:57,429 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/.tmp/f1/ef8a293675fb42bca6cc8eb4e558b89f as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1/ef8a293675fb42bca6cc8eb4e558b89f 2023-02-08 13:02:57,432 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/.tmp/f2/701d8d4cb0f1455693a7f36fc393e919 2023-02-08 13:02:57,437 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1/ef8a293675fb42bca6cc8eb4e558b89f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:02:57,438 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/.tmp/f2/0b6ea65d235e41e492246b8a4cd24ef3 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2/0b6ea65d235e41e492246b8a4cd24ef3 2023-02-08 13:02:57,442 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/.tmp/f1/4905b1d7fd78479cac3fdd7918fd2e25 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1/4905b1d7fd78479cac3fdd7918fd2e25 2023-02-08 13:02:57,446 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2/0b6ea65d235e41e492246b8a4cd24ef3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:02:57,448 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a999f4c483c2e332d2532c44631561ce in 299ms, sequenceid=9, compaction requested=false 2023-02-08 13:02:57,448 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a999f4c483c2e332d2532c44631561ce: 2023-02-08 13:02:57,448 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/.tmp/f2/6b2d9536928e44e5a38652826334432f 2023-02-08 13:02:57,448 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:57,449 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-08 13:02:57,449 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/.tmp/f2/91216766b9de40e8890bbdc670be5dd2 2023-02-08 13:02:57,451 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1/4905b1d7fd78479cac3fdd7918fd2e25, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:02:57,452 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/.tmp/f2/701d8d4cb0f1455693a7f36fc393e919 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2/701d8d4cb0f1455693a7f36fc393e919 2023-02-08 13:02:57,459 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/.tmp/f1/a01d6dc41f7745c4810d7a4e46c0efc3 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1/a01d6dc41f7745c4810d7a4e46c0efc3 2023-02-08 13:02:57,460 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/.tmp/f1/fe9c6d6920ac4be280a86ab514a17028 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1/fe9c6d6920ac4be280a86ab514a17028 2023-02-08 13:02:57,461 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2/701d8d4cb0f1455693a7f36fc393e919, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:02:57,462 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5dc36048c90a7ebfa122973d7d2b957e in 314ms, sequenceid=9, compaction requested=false 2023-02-08 13:02:57,462 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5dc36048c90a7ebfa122973d7d2b957e: 2023-02-08 13:02:57,462 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:57,462 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:57,462 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-08 13:02:57,463 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. started... 2023-02-08 13:02:57,463 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 34ed898d6bc0e38ef76fa255cd47e283 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:02:57,463 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/.tmp/f2/80df64f872ff403fb94bf074a53ef9e0 2023-02-08 13:02:57,475 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1/a01d6dc41f7745c4810d7a4e46c0efc3, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 13:02:57,477 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1/fe9c6d6920ac4be280a86ab514a17028, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:02:57,477 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/.tmp/f2/91216766b9de40e8890bbdc670be5dd2 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2/91216766b9de40e8890bbdc670be5dd2 2023-02-08 13:02:57,480 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/.tmp/f2/6b2d9536928e44e5a38652826334432f as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2/6b2d9536928e44e5a38652826334432f 2023-02-08 13:02:57,482 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/.tmp/f1/ab70648fd9c24b7bb875989da8a507b7 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1/ab70648fd9c24b7bb875989da8a507b7 2023-02-08 13:02:57,488 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2/91216766b9de40e8890bbdc670be5dd2, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 13:02:57,489 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 4e6088dbda8e673c8279ecc67bbf1b4a in 328ms, sequenceid=9, compaction requested=false 2023-02-08 13:02:57,490 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4e6088dbda8e673c8279ecc67bbf1b4a: 2023-02-08 13:02:57,490 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:57,490 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-08 13:02:57,490 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:57,490 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. started... 2023-02-08 13:02:57,490 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2/6b2d9536928e44e5a38652826334432f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:02:57,490 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 53392eb0fdd708840594d850c5b02119 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:02:57,491 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 646a3c1c46bd5c27e7bf1e3251adfca3 in 331ms, sequenceid=9, compaction requested=false 2023-02-08 13:02:57,491 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 646a3c1c46bd5c27e7bf1e3251adfca3: 2023-02-08 13:02:57,491 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:57,491 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-08 13:02:57,499 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1/ab70648fd9c24b7bb875989da8a507b7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:02:57,500 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/.tmp/f2/80df64f872ff403fb94bf074a53ef9e0 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2/80df64f872ff403fb94bf074a53ef9e0 2023-02-08 13:02:57,528 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/.tmp/f1/7cadb1364b10432eac4d26a65c3faaaf 2023-02-08 13:02:57,554 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2/80df64f872ff403fb94bf074a53ef9e0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:02:57,555 INFO [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 407e898b138d86648b3d6ad809a016b7 in 393ms, sequenceid=9, compaction requested=false 2023-02-08 13:02:57,555 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 407e898b138d86648b3d6ad809a016b7: 2023-02-08 13:02:57,556 DEBUG [rs(jenkins-hbase4.apache.org,42029,1675861371000)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:57,556 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-08 13:02:57,556 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-08 13:02:57,556 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:57,556 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-08 13:02:57,556 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42029,1675861371000' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-08 13:02:57,567 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:57,567 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:02:57,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:57,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:02:57,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:02:57,568 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:02:57,568 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:02:57,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:02:57,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:02:57,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:02:57,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:57,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:02:57,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42029,1675861371000' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-08 13:02:57,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a601af1[Count = 1] remaining members to acquire global barrier 2023-02-08 13:02:57,691 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/.tmp/f1/869b378611884fde84a1b6d9712f4204 2023-02-08 13:02:57,712 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/.tmp/f2/0d8bb6006b844fb98a40003061efbdeb 2023-02-08 13:02:57,718 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/.tmp/f1/869b378611884fde84a1b6d9712f4204 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1/869b378611884fde84a1b6d9712f4204 2023-02-08 13:02:57,725 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1/869b378611884fde84a1b6d9712f4204, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 13:02:57,726 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/.tmp/f2/0d8bb6006b844fb98a40003061efbdeb as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2/0d8bb6006b844fb98a40003061efbdeb 2023-02-08 13:02:57,731 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2/0d8bb6006b844fb98a40003061efbdeb, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 13:02:57,732 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 20c9d781a81b7de50e17d9cfcc362f04 in 571ms, sequenceid=9, compaction requested=false 2023-02-08 13:02:57,732 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 20c9d781a81b7de50e17d9cfcc362f04: 2023-02-08 13:02:57,733 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:57,733 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-08 13:02:57,967 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/.tmp/f1/ca9047427e1e4b28bd95a3097888bfaa 2023-02-08 13:02:57,984 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/.tmp/f2/3235580977ce41119b0ef8465666d665 2023-02-08 13:02:57,993 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/.tmp/f1/7cadb1364b10432eac4d26a65c3faaaf as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1/7cadb1364b10432eac4d26a65c3faaaf 2023-02-08 13:02:58,000 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1/7cadb1364b10432eac4d26a65c3faaaf, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:02:58,001 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/.tmp/f2/3235580977ce41119b0ef8465666d665 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2/3235580977ce41119b0ef8465666d665 2023-02-08 13:02:58,007 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2/3235580977ce41119b0ef8465666d665, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:02:58,008 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 34ed898d6bc0e38ef76fa255cd47e283 in 545ms, sequenceid=9, compaction requested=false 2023-02-08 13:02:58,009 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 34ed898d6bc0e38ef76fa255cd47e283: 2023-02-08 13:02:58,009 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:58,009 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-08 13:02:58,335 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 13:02:58,393 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/.tmp/f2/ceea91daa12048daaf625b84c4d6bded 2023-02-08 13:02:58,403 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/.tmp/f1/ca9047427e1e4b28bd95a3097888bfaa as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1/ca9047427e1e4b28bd95a3097888bfaa 2023-02-08 13:02:58,412 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-08 13:02:58,412 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1/ca9047427e1e4b28bd95a3097888bfaa, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:02:58,413 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/.tmp/f2/ceea91daa12048daaf625b84c4d6bded as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2/ceea91daa12048daaf625b84c4d6bded 2023-02-08 13:02:58,414 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-08 13:02:58,421 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2/ceea91daa12048daaf625b84c4d6bded, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:02:58,422 INFO [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 53392eb0fdd708840594d850c5b02119 in 932ms, sequenceid=9, compaction requested=false 2023-02-08 13:02:58,423 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 53392eb0fdd708840594d850c5b02119: 2023-02-08 13:02:58,423 DEBUG [rs(jenkins-hbase4.apache.org,45759,1675861370954)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:58,423 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-08 13:02:58,423 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-08 13:02:58,423 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,423 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-08 13:02:58,423 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45759,1675861370954' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-08 13:02:58,425 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:02:58,425 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:02:58,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:02:58,426 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:02:58,426 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:02:58,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:02:58,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:02:58,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:02:58,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:02:58,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45759,1675861370954' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-08 13:02:58,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a601af1[Count = 0] remaining members to acquire global barrier 2023-02-08 13:02:58,428 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-08 13:02:58,428 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:02:58,430 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:02:58,430 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:02:58,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:02:58,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:02:58,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:02:58,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:02:58,431 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-08 13:02:58,431 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-08 13:02:58,431 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-08 13:02:58,431 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,431 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,45759,1675861370954' in zk 2023-02-08 13:02:58,431 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-08 13:02:58,431 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42029,1675861371000' in zk 2023-02-08 13:02:58,432 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,432 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:02:58,433 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,433 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-08 13:02:58,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:02:58,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:02:58,434 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:02:58,434 DEBUG [member: 'jenkins-hbase4.apache.org,45759,1675861370954' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-08 13:02:58,435 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-08 13:02:58,435 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:02:58,435 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,435 DEBUG [member: 'jenkins-hbase4.apache.org,42029,1675861371000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-08 13:02:58,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:02:58,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:02:58,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:02:58,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:02:58,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:02:58,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,45759,1675861370954': 2023-02-08 13:02:58,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45759,1675861370954' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-08 13:02:58,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:02:58,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:02:58,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:02:58,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:02:58,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:02:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:02:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:02:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,42029,1675861371000': 2023-02-08 13:02:58,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42029,1675861371000' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-08 13:02:58,444 INFO [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-08 13:02:58,444 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:02:58,444 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:02:58,445 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-08 13:02:58,445 INFO [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 13:02:58,447 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:58,447 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:58,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:58,447 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:02:58,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:58,447 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:02:58,447 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:58,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:58,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:58,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:02:58,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:02:58,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:58,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:02:58,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:02:58,448 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:02:58,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:02:58,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:02:58,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:58,448 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:58,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:02:58,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:02:58,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:02:58,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,451 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,451 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:02:58,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:02:58,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,457 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:02:58,457 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:02:58,457 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:02:58,457 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,457 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:02:58,457 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:02:58,457 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:02:58,457 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:02:58,457 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:02:58,457 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:02:58,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:02:58,457 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:02:58,457 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:02:58,457 DEBUG [(jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:02:58,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-08 13:02:58,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 13:02:58,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:02:58,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:02:58,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:02:58,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:02:58,457 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:02:58,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-08 13:02:58,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:02:58,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:02:58,460 DEBUG [Listener at localhost/41037] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-08 13:02:58,460 DEBUG [Listener at localhost/41037] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 13:02:58,560 DEBUG [Listener at localhost/41037] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 13:02:58,561 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:02:58,561 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:02:58,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 13:02:58,665 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/hadoop-3553758321863628260.jar 2023-02-08 13:02:58,682 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675861375631 type: FLUSH version: 2 ttl: 0 2023-02-08 13:02:58,684 DEBUG [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce 2023-02-08 13:02:58,685 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(239): region to add: a999f4c483c2e332d2532c44631561ce 2023-02-08 13:02:58,685 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(239): region to add: 7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:02:58,686 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(239): region to add: e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:02:58,686 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(239): region to add: 20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:02:58,686 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(239): region to add: 4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:02:58,686 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(239): region to add: 5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:02:58,686 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(239): region to add: 34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:02:58,686 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(239): region to add: 407e898b138d86648b3d6ad809a016b7 2023-02-08 13:02:58,687 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(239): region to add: 53392eb0fdd708840594d850c5b02119 2023-02-08 13:02:58,687 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(239): region to add: 646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:02:58,687 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(585): clone region=a999f4c483c2e332d2532c44631561ce as a999f4c483c2e332d2532c44631561ce in snapshot testWithMapReduceMultiRegion 2023-02-08 13:02:58,687 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(585): clone region=7c6e8f9ce48294c939364df74fd31b84 as 7c6e8f9ce48294c939364df74fd31b84 in snapshot testWithMapReduceMultiRegion 2023-02-08 13:02:58,687 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(585): clone region=e8458dcff1a335275f5bab3da4be4ba8 as e8458dcff1a335275f5bab3da4be4ba8 in snapshot testWithMapReduceMultiRegion 2023-02-08 13:02:58,687 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(585): clone region=20c9d781a81b7de50e17d9cfcc362f04 as 20c9d781a81b7de50e17d9cfcc362f04 in snapshot testWithMapReduceMultiRegion 2023-02-08 13:02:58,687 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(585): clone region=4e6088dbda8e673c8279ecc67bbf1b4a as 4e6088dbda8e673c8279ecc67bbf1b4a in snapshot testWithMapReduceMultiRegion 2023-02-08 13:02:58,687 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(585): clone region=5dc36048c90a7ebfa122973d7d2b957e as 5dc36048c90a7ebfa122973d7d2b957e in snapshot testWithMapReduceMultiRegion 2023-02-08 13:02:58,688 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(585): clone region=34ed898d6bc0e38ef76fa255cd47e283 as 34ed898d6bc0e38ef76fa255cd47e283 in snapshot testWithMapReduceMultiRegion 2023-02-08 13:02:58,688 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(585): clone region=407e898b138d86648b3d6ad809a016b7 as 407e898b138d86648b3d6ad809a016b7 in snapshot testWithMapReduceMultiRegion 2023-02-08 13:02:58,688 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(585): clone region=53392eb0fdd708840594d850c5b02119 as 53392eb0fdd708840594d850c5b02119 in snapshot testWithMapReduceMultiRegion 2023-02-08 13:02:58,688 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(585): clone region=646a3c1c46bd5c27e7bf1e3251adfca3 as 646a3c1c46bd5c27e7bf1e3251adfca3 in snapshot testWithMapReduceMultiRegion 2023-02-08 13:02:58,692 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => a999f4c483c2e332d2532c44631561ce, NAME => 'testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f 2023-02-08 13:02:58,693 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => e8458dcff1a335275f5bab3da4be4ba8, NAME => 'testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f 2023-02-08 13:02:58,693 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7c6e8f9ce48294c939364df74fd31b84, NAME => 'testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f 2023-02-08 13:02:58,693 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 20c9d781a81b7de50e17d9cfcc362f04, NAME => 'testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f 2023-02-08 13:02:58,694 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 5dc36048c90a7ebfa122973d7d2b957e, NAME => 'testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f 2023-02-08 13:02:58,694 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 4e6088dbda8e673c8279ecc67bbf1b4a, NAME => 'testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f 2023-02-08 13:02:58,694 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 34ed898d6bc0e38ef76fa255cd47e283, NAME => 'testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f 2023-02-08 13:02:58,694 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 407e898b138d86648b3d6ad809a016b7, NAME => 'testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f 2023-02-08 13:02:58,732 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:58,733 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f06814bdc27c43ab802ac0786229f47c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,740 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 98deec41e5aa4834a00c8934b0f882ba from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,744 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:58,744 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing e8458dcff1a335275f5bab3da4be4ba8, disabling compactions & flushes 2023-02-08 13:02:58,744 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:58,744 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:58,745 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. after waiting 0 ms 2023-02-08 13:02:58,745 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:58,745 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:02:58,745 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for e8458dcff1a335275f5bab3da4be4ba8: Waiting for close lock at 1675861378744Disabling compacts and flushes for region at 1675861378744Disabling writes for close at 1675861378745 (+1 ms)Writing region close event to WAL at 1675861378745Closed at 1675861378745 2023-02-08 13:02:58,745 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 53392eb0fdd708840594d850c5b02119, NAME => 'testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f 2023-02-08 13:02:58,748 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:58,748 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:58,748 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fcd241950ddb4edaaf1ca20d1bce234e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,748 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink da4a663f488947d2b8100ca5604f17a5 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,757 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:58,757 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 7c6e8f9ce48294c939364df74fd31b84, disabling compactions & flushes 2023-02-08 13:02:58,757 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:58,757 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:58,757 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. after waiting 0 ms 2023-02-08 13:02:58,757 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:58,757 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:02:58,757 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 7c6e8f9ce48294c939364df74fd31b84: Waiting for close lock at 1675861378757Disabling compacts and flushes for region at 1675861378757Disabling writes for close at 1675861378757Writing region close event to WAL at 1675861378757Closed at 1675861378757 2023-02-08 13:02:58,758 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 646a3c1c46bd5c27e7bf1e3251adfca3, NAME => 'testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f 2023-02-08 13:02:58,759 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 407e898b138d86648b3d6ad809a016b7, disabling compactions & flushes 2023-02-08 13:02:58,759 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:58,759 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:58,759 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. after waiting 0 ms 2023-02-08 13:02:58,759 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:58,759 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:02:58,759 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 407e898b138d86648b3d6ad809a016b7: Waiting for close lock at 1675861378759Disabling compacts and flushes for region at 1675861378759Disabling writes for close at 1675861378759Writing region close event to WAL at 1675861378759Closed at 1675861378759 2023-02-08 13:02:58,774 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:58,774 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ec0a53e2598f4a1888bedfe3182dcf65 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,774 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 99df961875964972ba3f812eb3407032 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,774 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:58,774 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c19037465ce9483dabc0ee14319f7d6d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,778 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d763cb9566ff475e9bc84ff01992c579 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,784 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c5ba6263294a410186948d443da0ac57 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,784 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:58,784 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 75bd0c5ff5504e39b20aa5f05d728b85 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,789 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 20c9d781a81b7de50e17d9cfcc362f04, disabling compactions & flushes 2023-02-08 13:02:58,789 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:58,789 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:58,789 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. after waiting 0 ms 2023-02-08 13:02:58,789 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:58,790 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:58,790 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 20c9d781a81b7de50e17d9cfcc362f04: Waiting for close lock at 1675861378789Disabling compacts and flushes for region at 1675861378789Disabling writes for close at 1675861378789Writing region close event to WAL at 1675861378790 (+1 ms)Closed at 1675861378790 2023-02-08 13:02:58,792 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 34ed898d6bc0e38ef76fa255cd47e283, disabling compactions & flushes 2023-02-08 13:02:58,792 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:58,792 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:58,792 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. after waiting 0 ms 2023-02-08 13:02:58,792 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:58,792 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:02:58,792 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 34ed898d6bc0e38ef76fa255cd47e283: Waiting for close lock at 1675861378792Disabling compacts and flushes for region at 1675861378792Disabling writes for close at 1675861378792Writing region close event to WAL at 1675861378792Closed at 1675861378792 2023-02-08 13:02:58,793 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 520e615c81e74caf9750901c7cc8a4e7 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,793 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6d7cb531319144d79eb17784213e3289 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,793 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:58,793 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 88056020e3d24ae0b2b65116285eb2a2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,796 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 4e6088dbda8e673c8279ecc67bbf1b4a, disabling compactions & flushes 2023-02-08 13:02:58,796 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:58,796 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:58,796 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. after waiting 0 ms 2023-02-08 13:02:58,796 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:58,796 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:02:58,796 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 4e6088dbda8e673c8279ecc67bbf1b4a: Waiting for close lock at 1675861378796Disabling compacts and flushes for region at 1675861378796Disabling writes for close at 1675861378796Writing region close event to WAL at 1675861378796Closed at 1675861378796 2023-02-08 13:02:58,800 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e23a88fadc3447878ceb5de90642291e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,800 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 5dc36048c90a7ebfa122973d7d2b957e, disabling compactions & flushes 2023-02-08 13:02:58,800 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing a999f4c483c2e332d2532c44631561ce, disabling compactions & flushes 2023-02-08 13:02:58,800 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:58,800 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:58,800 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:58,800 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:58,800 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. after waiting 0 ms 2023-02-08 13:02:58,800 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. after waiting 0 ms 2023-02-08 13:02:58,800 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:58,800 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:58,800 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:02:58,800 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:02:58,801 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 5dc36048c90a7ebfa122973d7d2b957e: Waiting for close lock at 1675861378800Disabling compacts and flushes for region at 1675861378800Disabling writes for close at 1675861378800Writing region close event to WAL at 1675861378800Closed at 1675861378800 2023-02-08 13:02:58,801 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for a999f4c483c2e332d2532c44631561ce: Waiting for close lock at 1675861378800Disabling compacts and flushes for region at 1675861378800Disabling writes for close at 1675861378800Writing region close event to WAL at 1675861378800Closed at 1675861378800 2023-02-08 13:02:58,805 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 53392eb0fdd708840594d850c5b02119, disabling compactions & flushes 2023-02-08 13:02:58,805 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:58,805 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:58,805 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. after waiting 0 ms 2023-02-08 13:02:58,805 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:58,805 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:02:58,805 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 53392eb0fdd708840594d850c5b02119: Waiting for close lock at 1675861378805Disabling compacts and flushes for region at 1675861378805Disabling writes for close at 1675861378805Writing region close event to WAL at 1675861378805Closed at 1675861378805 2023-02-08 13:02:58,806 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:58,806 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5e48cf6c7d5746f1a7b2d7f766ba8bc8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,809 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4365f72439254dc68c93f7104c850c40 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-08 13:02:58,811 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 646a3c1c46bd5c27e7bf1e3251adfca3, disabling compactions & flushes 2023-02-08 13:02:58,811 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:58,811 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:58,811 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. after waiting 0 ms 2023-02-08 13:02:58,811 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:58,811 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:02:58,811 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 646a3c1c46bd5c27e7bf1e3251adfca3: Waiting for close lock at 1675861378811Disabling compacts and flushes for region at 1675861378811Disabling writes for close at 1675861378811Writing region close event to WAL at 1675861378811Closed at 1675861378811 2023-02-08 13:02:58,812 INFO [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675861375631 type: FLUSH version: 2 ttl: 0 2023-02-08 13:02:58,812 DEBUG [Listener at localhost/41037] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f 2023-02-08 13:02:58,812 DEBUG [Listener at localhost/41037] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f 2023-02-08 13:02:58,813 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-data/ 2023-02-08 13:02:58,813 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |----default/ 2023-02-08 13:02:58,814 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-08 13:02:58,814 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |----------20c9d781a81b7de50e17d9cfcc362f04/ 2023-02-08 13:02:58,815 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:02:58,815 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:02:58,815 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=20c9d781a81b7de50e17d9cfcc362f04-fcd241950ddb4edaaf1ca20d1bce234e 2023-02-08 13:02:58,815 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:02:58,816 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=20c9d781a81b7de50e17d9cfcc362f04-d763cb9566ff475e9bc84ff01992c579 2023-02-08 13:02:58,816 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |----------34ed898d6bc0e38ef76fa255cd47e283/ 2023-02-08 13:02:58,817 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:02:58,817 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:02:58,817 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=34ed898d6bc0e38ef76fa255cd47e283-da4a663f488947d2b8100ca5604f17a5 2023-02-08 13:02:58,817 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:02:58,818 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=34ed898d6bc0e38ef76fa255cd47e283-99df961875964972ba3f812eb3407032 2023-02-08 13:02:58,818 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |----------407e898b138d86648b3d6ad809a016b7/ 2023-02-08 13:02:58,818 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:02:58,819 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:02:58,819 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=407e898b138d86648b3d6ad809a016b7-f06814bdc27c43ab802ac0786229f47c 2023-02-08 13:02:58,819 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:02:58,820 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=407e898b138d86648b3d6ad809a016b7-98deec41e5aa4834a00c8934b0f882ba 2023-02-08 13:02:58,820 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |----------4e6088dbda8e673c8279ecc67bbf1b4a/ 2023-02-08 13:02:58,820 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:02:58,820 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:02:58,821 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=4e6088dbda8e673c8279ecc67bbf1b4a-ec0a53e2598f4a1888bedfe3182dcf65 2023-02-08 13:02:58,821 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:02:58,821 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=4e6088dbda8e673c8279ecc67bbf1b4a-c5ba6263294a410186948d443da0ac57 2023-02-08 13:02:58,822 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |----------53392eb0fdd708840594d850c5b02119/ 2023-02-08 13:02:58,822 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:02:58,822 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:02:58,823 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=53392eb0fdd708840594d850c5b02119-88056020e3d24ae0b2b65116285eb2a2 2023-02-08 13:02:58,823 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:02:58,823 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=53392eb0fdd708840594d850c5b02119-e23a88fadc3447878ceb5de90642291e 2023-02-08 13:02:58,824 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |----------5dc36048c90a7ebfa122973d7d2b957e/ 2023-02-08 13:02:58,824 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:02:58,824 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:02:58,825 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=5dc36048c90a7ebfa122973d7d2b957e-c19037465ce9483dabc0ee14319f7d6d 2023-02-08 13:02:58,825 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:02:58,825 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=5dc36048c90a7ebfa122973d7d2b957e-6d7cb531319144d79eb17784213e3289 2023-02-08 13:02:58,825 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |----------646a3c1c46bd5c27e7bf1e3251adfca3/ 2023-02-08 13:02:58,826 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:02:58,826 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:02:58,827 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=646a3c1c46bd5c27e7bf1e3251adfca3-5e48cf6c7d5746f1a7b2d7f766ba8bc8 2023-02-08 13:02:58,827 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:02:58,827 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=646a3c1c46bd5c27e7bf1e3251adfca3-4365f72439254dc68c93f7104c850c40 2023-02-08 13:02:58,827 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |----------7c6e8f9ce48294c939364df74fd31b84/ 2023-02-08 13:02:58,828 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:02:58,828 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |----------a999f4c483c2e332d2532c44631561ce/ 2023-02-08 13:02:58,829 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:02:58,829 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:02:58,829 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=a999f4c483c2e332d2532c44631561ce-75bd0c5ff5504e39b20aa5f05d728b85 2023-02-08 13:02:58,829 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:02:58,830 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |----------------testWithMapReduce=a999f4c483c2e332d2532c44631561ce-520e615c81e74caf9750901c7cc8a4e7 2023-02-08 13:02:58,830 DEBUG [Listener at localhost/41037] util.CommonFSUtils(699): |----------e8458dcff1a335275f5bab3da4be4ba8/ 2023-02-08 13:02:58,831 DEBUG [Listener at localhost/41037] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:02:58,841 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,842 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,842 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,843 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,843 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,844 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,844 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,913 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/hadoop-8614806387539529201.jar 2023-02-08 13:02:58,914 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,914 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,914 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,915 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,915 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,916 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,916 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-08 13:02:58,916 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-08 13:02:58,917 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-08 13:02:58,917 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-08 13:02:58,918 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-08 13:02:58,918 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-08 13:02:58,919 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-08 13:02:58,919 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-08 13:02:58,919 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-08 13:02:58,920 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-08 13:02:58,925 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-08 13:02:58,925 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 13:02:58,925 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 13:02:58,926 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 13:02:58,926 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-08 13:02:58,993 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/hadoop-9170353749732215232.jar 2023-02-08 13:02:58,993 DEBUG [Listener at localhost/41037] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-08 13:02:59,052 WARN [Listener at localhost/41037] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-08 13:02:59,118 INFO [Listener at localhost/41037] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-08 13:02:59,551 WARN [Listener at localhost/41037] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/mapreduce.cluster.local.dir/1675861379472/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-08 13:02:59,551 WARN [Listener at localhost/41037] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/mapreduce.cluster.local.dir/1675861379472/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-08 13:02:59,707 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:59,707 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:02:59,709 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:02:59,712 INFO [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:02:59,713 DEBUG [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1 2023-02-08 13:02:59,714 INFO [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20c9d781a81b7de50e17d9cfcc362f04 columnFamilyName f1 2023-02-08 13:02:59,721 DEBUG [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1/testWithMapReduce=20c9d781a81b7de50e17d9cfcc362f04-fcd241950ddb4edaaf1ca20d1bce234e 2023-02-08 13:02:59,722 INFO [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] regionserver.HStore(310): Store=20c9d781a81b7de50e17d9cfcc362f04/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:59,722 INFO [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:02:59,723 DEBUG [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2 2023-02-08 13:02:59,723 INFO [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20c9d781a81b7de50e17d9cfcc362f04 columnFamilyName f2 2023-02-08 13:02:59,729 DEBUG [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2/testWithMapReduce=20c9d781a81b7de50e17d9cfcc362f04-d763cb9566ff475e9bc84ff01992c579 2023-02-08 13:02:59,729 INFO [StoreOpener-20c9d781a81b7de50e17d9cfcc362f04-1] regionserver.HStore(310): Store=20c9d781a81b7de50e17d9cfcc362f04/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:59,730 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:02:59,730 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 20c9d781a81b7de50e17d9cfcc362f04; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65945205, jitterRate=-0.01733987033367157}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:02:59,730 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 20c9d781a81b7de50e17d9cfcc362f04: Writing region info on filesystem at 1675861379709Initializing all the Stores at 1675861379711 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861379711Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861379711Region opened successfully at 1675861379730 (+19 ms) 2023-02-08 13:02:59,887 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 13:02:59,888 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-08 13:02:59,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 20c9d781a81b7de50e17d9cfcc362f04, disabling compactions & flushes 2023-02-08 13:02:59,921 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:59,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:59,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. after waiting 0 ms 2023-02-08 13:02:59,921 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:59,924 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:02:59,924 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 20c9d781a81b7de50e17d9cfcc362f04: Waiting for close lock at 1675861379921Disabling compacts and flushes for region at 1675861379921Disabling writes for close at 1675861379921Writing region close event to WAL at 1675861379924 (+3 ms)Closed at 1675861379924 2023-02-08 13:02:59,939 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:02:59,939 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:02:59,941 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:02:59,944 INFO [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 407e898b138d86648b3d6ad809a016b7 2023-02-08 13:02:59,945 DEBUG [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1 2023-02-08 13:02:59,946 INFO [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 407e898b138d86648b3d6ad809a016b7 columnFamilyName f1 2023-02-08 13:02:59,953 DEBUG [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1/testWithMapReduce=407e898b138d86648b3d6ad809a016b7-f06814bdc27c43ab802ac0786229f47c 2023-02-08 13:02:59,953 INFO [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] regionserver.HStore(310): Store=407e898b138d86648b3d6ad809a016b7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:59,953 INFO [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 407e898b138d86648b3d6ad809a016b7 2023-02-08 13:02:59,954 DEBUG [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2 2023-02-08 13:02:59,955 INFO [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 407e898b138d86648b3d6ad809a016b7 columnFamilyName f2 2023-02-08 13:02:59,961 DEBUG [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2/testWithMapReduce=407e898b138d86648b3d6ad809a016b7-98deec41e5aa4834a00c8934b0f882ba 2023-02-08 13:02:59,961 INFO [StoreOpener-407e898b138d86648b3d6ad809a016b7-1] regionserver.HStore(310): Store=407e898b138d86648b3d6ad809a016b7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:02:59,962 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:02:59,962 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 407e898b138d86648b3d6ad809a016b7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61083304, jitterRate=-0.08978784084320068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:02:59,962 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 407e898b138d86648b3d6ad809a016b7: Writing region info on filesystem at 1675861379942Initializing all the Stores at 1675861379943 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861379943Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861379943Region opened successfully at 1675861379962 (+19 ms) 2023-02-08 13:03:00,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 407e898b138d86648b3d6ad809a016b7, disabling compactions & flushes 2023-02-08 13:03:00,015 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:03:00,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:03:00,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. after waiting 0 ms 2023-02-08 13:03:00,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:03:00,019 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:03:00,019 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 407e898b138d86648b3d6ad809a016b7: Waiting for close lock at 1675861380015Disabling compacts and flushes for region at 1675861380015Disabling writes for close at 1675861380015Writing region close event to WAL at 1675861380019 (+4 ms)Closed at 1675861380019 2023-02-08 13:03:00,025 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:00,025 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:00,026 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:00,030 INFO [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a999f4c483c2e332d2532c44631561ce 2023-02-08 13:03:00,031 DEBUG [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1 2023-02-08 13:03:00,032 INFO [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a999f4c483c2e332d2532c44631561ce columnFamilyName f1 2023-02-08 13:03:00,038 DEBUG [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1/testWithMapReduce=a999f4c483c2e332d2532c44631561ce-75bd0c5ff5504e39b20aa5f05d728b85 2023-02-08 13:03:00,039 INFO [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] regionserver.HStore(310): Store=a999f4c483c2e332d2532c44631561ce/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,039 INFO [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a999f4c483c2e332d2532c44631561ce 2023-02-08 13:03:00,040 DEBUG [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2 2023-02-08 13:03:00,040 INFO [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a999f4c483c2e332d2532c44631561ce columnFamilyName f2 2023-02-08 13:03:00,050 DEBUG [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2/testWithMapReduce=a999f4c483c2e332d2532c44631561ce-520e615c81e74caf9750901c7cc8a4e7 2023-02-08 13:03:00,050 INFO [StoreOpener-a999f4c483c2e332d2532c44631561ce-1] regionserver.HStore(310): Store=a999f4c483c2e332d2532c44631561ce/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,050 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:00,050 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a999f4c483c2e332d2532c44631561ce; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71190206, jitterRate=0.06081673502922058}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:00,050 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a999f4c483c2e332d2532c44631561ce: Writing region info on filesystem at 1675861380026Initializing all the Stores at 1675861380027 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380027Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380030 (+3 ms)Region opened successfully at 1675861380050 (+20 ms) 2023-02-08 13:03:00,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a999f4c483c2e332d2532c44631561ce, disabling compactions & flushes 2023-02-08 13:03:00,098 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:03:00,099 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:03:00,099 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. after waiting 0 ms 2023-02-08 13:03:00,099 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:03:00,102 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:03:00,102 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a999f4c483c2e332d2532c44631561ce: Waiting for close lock at 1675861380098Disabling compacts and flushes for region at 1675861380098Disabling writes for close at 1675861380099 (+1 ms)Writing region close event to WAL at 1675861380102 (+3 ms)Closed at 1675861380102 2023-02-08 13:03:00,107 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:00,107 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:00,108 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:00,110 INFO [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:03:00,112 DEBUG [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1 2023-02-08 13:03:00,112 INFO [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e6088dbda8e673c8279ecc67bbf1b4a columnFamilyName f1 2023-02-08 13:03:00,119 DEBUG [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1/testWithMapReduce=4e6088dbda8e673c8279ecc67bbf1b4a-ec0a53e2598f4a1888bedfe3182dcf65 2023-02-08 13:03:00,119 INFO [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] regionserver.HStore(310): Store=4e6088dbda8e673c8279ecc67bbf1b4a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,119 INFO [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:03:00,120 DEBUG [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2 2023-02-08 13:03:00,121 INFO [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e6088dbda8e673c8279ecc67bbf1b4a columnFamilyName f2 2023-02-08 13:03:00,127 DEBUG [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2/testWithMapReduce=4e6088dbda8e673c8279ecc67bbf1b4a-c5ba6263294a410186948d443da0ac57 2023-02-08 13:03:00,127 INFO [StoreOpener-4e6088dbda8e673c8279ecc67bbf1b4a-1] regionserver.HStore(310): Store=4e6088dbda8e673c8279ecc67bbf1b4a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,127 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:00,128 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4e6088dbda8e673c8279ecc67bbf1b4a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60172707, jitterRate=-0.10335679352283478}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:00,128 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4e6088dbda8e673c8279ecc67bbf1b4a: Writing region info on filesystem at 1675861380108Initializing all the Stores at 1675861380109 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380110 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380110Region opened successfully at 1675861380128 (+18 ms) 2023-02-08 13:03:00,168 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4e6088dbda8e673c8279ecc67bbf1b4a, disabling compactions & flushes 2023-02-08 13:03:00,168 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:03:00,168 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:03:00,168 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. after waiting 0 ms 2023-02-08 13:03:00,168 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:03:00,172 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:03:00,172 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4e6088dbda8e673c8279ecc67bbf1b4a: Waiting for close lock at 1675861380168Disabling compacts and flushes for region at 1675861380168Disabling writes for close at 1675861380168Writing region close event to WAL at 1675861380172 (+4 ms)Closed at 1675861380172 2023-02-08 13:03:00,177 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:00,177 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:00,183 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:00,191 INFO [StoreOpener-53392eb0fdd708840594d850c5b02119-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 53392eb0fdd708840594d850c5b02119 2023-02-08 13:03:00,193 DEBUG [StoreOpener-53392eb0fdd708840594d850c5b02119-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1 2023-02-08 13:03:00,193 INFO [StoreOpener-53392eb0fdd708840594d850c5b02119-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53392eb0fdd708840594d850c5b02119 columnFamilyName f1 2023-02-08 13:03:00,200 DEBUG [StoreOpener-53392eb0fdd708840594d850c5b02119-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1/testWithMapReduce=53392eb0fdd708840594d850c5b02119-88056020e3d24ae0b2b65116285eb2a2 2023-02-08 13:03:00,200 INFO [StoreOpener-53392eb0fdd708840594d850c5b02119-1] regionserver.HStore(310): Store=53392eb0fdd708840594d850c5b02119/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,200 INFO [StoreOpener-53392eb0fdd708840594d850c5b02119-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 53392eb0fdd708840594d850c5b02119 2023-02-08 13:03:00,201 DEBUG [StoreOpener-53392eb0fdd708840594d850c5b02119-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2 2023-02-08 13:03:00,202 INFO [StoreOpener-53392eb0fdd708840594d850c5b02119-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53392eb0fdd708840594d850c5b02119 columnFamilyName f2 2023-02-08 13:03:00,207 DEBUG [StoreOpener-53392eb0fdd708840594d850c5b02119-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2/testWithMapReduce=53392eb0fdd708840594d850c5b02119-e23a88fadc3447878ceb5de90642291e 2023-02-08 13:03:00,207 INFO [StoreOpener-53392eb0fdd708840594d850c5b02119-1] regionserver.HStore(310): Store=53392eb0fdd708840594d850c5b02119/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,208 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:00,208 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 53392eb0fdd708840594d850c5b02119; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73606579, jitterRate=0.09682349860668182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:00,208 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 53392eb0fdd708840594d850c5b02119: Writing region info on filesystem at 1675861380183Initializing all the Stores at 1675861380184 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380184Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380190 (+6 ms)Region opened successfully at 1675861380208 (+18 ms) 2023-02-08 13:03:00,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 53392eb0fdd708840594d850c5b02119, disabling compactions & flushes 2023-02-08 13:03:00,268 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:03:00,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:03:00,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. after waiting 0 ms 2023-02-08 13:03:00,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:03:00,271 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:03:00,272 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 53392eb0fdd708840594d850c5b02119: Waiting for close lock at 1675861380268Disabling compacts and flushes for region at 1675861380268Disabling writes for close at 1675861380268Writing region close event to WAL at 1675861380271 (+3 ms)Closed at 1675861380271 2023-02-08 13:03:00,278 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:00,278 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:00,280 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:00,283 INFO [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:03:00,284 DEBUG [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1 2023-02-08 13:03:00,285 INFO [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5dc36048c90a7ebfa122973d7d2b957e columnFamilyName f1 2023-02-08 13:03:00,291 DEBUG [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1/testWithMapReduce=5dc36048c90a7ebfa122973d7d2b957e-c19037465ce9483dabc0ee14319f7d6d 2023-02-08 13:03:00,292 INFO [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] regionserver.HStore(310): Store=5dc36048c90a7ebfa122973d7d2b957e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,292 INFO [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:03:00,293 DEBUG [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2 2023-02-08 13:03:00,293 INFO [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5dc36048c90a7ebfa122973d7d2b957e columnFamilyName f2 2023-02-08 13:03:00,298 DEBUG [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2/testWithMapReduce=5dc36048c90a7ebfa122973d7d2b957e-6d7cb531319144d79eb17784213e3289 2023-02-08 13:03:00,299 INFO [StoreOpener-5dc36048c90a7ebfa122973d7d2b957e-1] regionserver.HStore(310): Store=5dc36048c90a7ebfa122973d7d2b957e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,299 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:00,299 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5dc36048c90a7ebfa122973d7d2b957e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63368408, jitterRate=-0.05573713779449463}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:00,299 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5dc36048c90a7ebfa122973d7d2b957e: Writing region info on filesystem at 1675861380280Initializing all the Stores at 1675861380281 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380281Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380283 (+2 ms)Region opened successfully at 1675861380299 (+16 ms) 2023-02-08 13:03:00,363 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5dc36048c90a7ebfa122973d7d2b957e, disabling compactions & flushes 2023-02-08 13:03:00,363 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:03:00,363 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:03:00,363 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. after waiting 0 ms 2023-02-08 13:03:00,363 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:03:00,367 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:03:00,367 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5dc36048c90a7ebfa122973d7d2b957e: Waiting for close lock at 1675861380363Disabling compacts and flushes for region at 1675861380363Disabling writes for close at 1675861380363Writing region close event to WAL at 1675861380367 (+4 ms)Closed at 1675861380367 2023-02-08 13:03:00,373 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:00,374 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:00,376 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:00,378 INFO [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:03:00,379 DEBUG [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1 2023-02-08 13:03:00,379 INFO [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 646a3c1c46bd5c27e7bf1e3251adfca3 columnFamilyName f1 2023-02-08 13:03:00,385 DEBUG [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1/testWithMapReduce=646a3c1c46bd5c27e7bf1e3251adfca3-5e48cf6c7d5746f1a7b2d7f766ba8bc8 2023-02-08 13:03:00,385 INFO [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] regionserver.HStore(310): Store=646a3c1c46bd5c27e7bf1e3251adfca3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,385 INFO [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:03:00,386 DEBUG [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2 2023-02-08 13:03:00,387 INFO [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 646a3c1c46bd5c27e7bf1e3251adfca3 columnFamilyName f2 2023-02-08 13:03:00,392 DEBUG [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2/testWithMapReduce=646a3c1c46bd5c27e7bf1e3251adfca3-4365f72439254dc68c93f7104c850c40 2023-02-08 13:03:00,392 INFO [StoreOpener-646a3c1c46bd5c27e7bf1e3251adfca3-1] regionserver.HStore(310): Store=646a3c1c46bd5c27e7bf1e3251adfca3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,393 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:00,393 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 646a3c1c46bd5c27e7bf1e3251adfca3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60089367, jitterRate=-0.10459865629673004}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:00,393 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 646a3c1c46bd5c27e7bf1e3251adfca3: Writing region info on filesystem at 1675861380376Initializing all the Stores at 1675861380377 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380377Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380377Region opened successfully at 1675861380393 (+16 ms) 2023-02-08 13:03:00,421 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 646a3c1c46bd5c27e7bf1e3251adfca3, disabling compactions & flushes 2023-02-08 13:03:00,422 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:03:00,422 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:03:00,422 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. after waiting 0 ms 2023-02-08 13:03:00,422 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:03:00,430 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:03:00,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 646a3c1c46bd5c27e7bf1e3251adfca3: Waiting for close lock at 1675861380421Disabling compacts and flushes for region at 1675861380421Disabling writes for close at 1675861380422 (+1 ms)Writing region close event to WAL at 1675861380430 (+8 ms)Closed at 1675861380430 2023-02-08 13:03:00,435 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:00,435 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:00,438 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:00,440 INFO [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:03:00,441 DEBUG [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8/f1 2023-02-08 13:03:00,442 INFO [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8458dcff1a335275f5bab3da4be4ba8 columnFamilyName f1 2023-02-08 13:03:00,443 INFO [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] regionserver.HStore(310): Store=e8458dcff1a335275f5bab3da4be4ba8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,443 INFO [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:03:00,444 DEBUG [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8/f2 2023-02-08 13:03:00,445 INFO [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8458dcff1a335275f5bab3da4be4ba8 columnFamilyName f2 2023-02-08 13:03:00,445 INFO [StoreOpener-e8458dcff1a335275f5bab3da4be4ba8-1] regionserver.HStore(310): Store=e8458dcff1a335275f5bab3da4be4ba8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,445 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:00,446 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e8458dcff1a335275f5bab3da4be4ba8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68774226, jitterRate=0.02481582760810852}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:00,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e8458dcff1a335275f5bab3da4be4ba8: Writing region info on filesystem at 1675861380438Initializing all the Stores at 1675861380439 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380439Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380439Region opened successfully at 1675861380446 (+7 ms) 2023-02-08 13:03:00,463 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e8458dcff1a335275f5bab3da4be4ba8, disabling compactions & flushes 2023-02-08 13:03:00,463 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:03:00,463 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:03:00,463 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. after waiting 0 ms 2023-02-08 13:03:00,463 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:03:00,464 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:03:00,464 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e8458dcff1a335275f5bab3da4be4ba8: Waiting for close lock at 1675861380463Disabling compacts and flushes for region at 1675861380463Disabling writes for close at 1675861380463Writing region close event to WAL at 1675861380464 (+1 ms)Closed at 1675861380464 2023-02-08 13:03:00,470 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:00,470 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:00,471 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:00,472 INFO [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:03:00,473 DEBUG [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84/f1 2023-02-08 13:03:00,474 INFO [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c6e8f9ce48294c939364df74fd31b84 columnFamilyName f1 2023-02-08 13:03:00,474 INFO [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] regionserver.HStore(310): Store=7c6e8f9ce48294c939364df74fd31b84/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,474 INFO [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:03:00,475 DEBUG [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84/f2 2023-02-08 13:03:00,476 INFO [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c6e8f9ce48294c939364df74fd31b84 columnFamilyName f2 2023-02-08 13:03:00,476 INFO [StoreOpener-7c6e8f9ce48294c939364df74fd31b84-1] regionserver.HStore(310): Store=7c6e8f9ce48294c939364df74fd31b84/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,476 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:00,477 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7c6e8f9ce48294c939364df74fd31b84; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63777860, jitterRate=-0.04963582754135132}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:00,477 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7c6e8f9ce48294c939364df74fd31b84: Writing region info on filesystem at 1675861380471Initializing all the Stores at 1675861380471Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380471Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380472 (+1 ms)Region opened successfully at 1675861380477 (+5 ms) 2023-02-08 13:03:00,493 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7c6e8f9ce48294c939364df74fd31b84, disabling compactions & flushes 2023-02-08 13:03:00,494 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:03:00,494 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:03:00,494 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. after waiting 0 ms 2023-02-08 13:03:00,494 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:03:00,494 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:03:00,494 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7c6e8f9ce48294c939364df74fd31b84: Waiting for close lock at 1675861380493Disabling compacts and flushes for region at 1675861380493Disabling writes for close at 1675861380494 (+1 ms)Writing region close event to WAL at 1675861380494Closed at 1675861380494 2023-02-08 13:03:00,499 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:00,499 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:00,500 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:00,502 INFO [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:03:00,503 DEBUG [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1 2023-02-08 13:03:00,503 INFO [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34ed898d6bc0e38ef76fa255cd47e283 columnFamilyName f1 2023-02-08 13:03:00,509 DEBUG [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1/testWithMapReduce=34ed898d6bc0e38ef76fa255cd47e283-da4a663f488947d2b8100ca5604f17a5 2023-02-08 13:03:00,509 INFO [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] regionserver.HStore(310): Store=34ed898d6bc0e38ef76fa255cd47e283/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,509 INFO [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:03:00,510 DEBUG [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2 2023-02-08 13:03:00,511 INFO [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34ed898d6bc0e38ef76fa255cd47e283 columnFamilyName f2 2023-02-08 13:03:00,516 DEBUG [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] regionserver.HStore(539): loaded hdfs://localhost:46787/user/jenkins/test-data/858b37d3-6ffc-b7b6-dbbf-bd6733a9c84e/testWithMapReduceMultiRegion/ce81b8b9-a16f-41bd-89fe-c60394dc6d2f/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2/testWithMapReduce=34ed898d6bc0e38ef76fa255cd47e283-99df961875964972ba3f812eb3407032 2023-02-08 13:03:00,516 INFO [StoreOpener-34ed898d6bc0e38ef76fa255cd47e283-1] regionserver.HStore(310): Store=34ed898d6bc0e38ef76fa255cd47e283/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:00,516 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:00,516 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 34ed898d6bc0e38ef76fa255cd47e283; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66925486, jitterRate=-0.0027325451374053955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:00,516 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 34ed898d6bc0e38ef76fa255cd47e283: Writing region info on filesystem at 1675861380500Initializing all the Stores at 1675861380501 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380501Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861380501Region opened successfully at 1675861380516 (+15 ms) 2023-02-08 13:03:00,544 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 34ed898d6bc0e38ef76fa255cd47e283, disabling compactions & flushes 2023-02-08 13:03:00,544 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:03:00,544 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:03:00,544 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. after waiting 0 ms 2023-02-08 13:03:00,544 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:03:00,547 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:03:00,547 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 34ed898d6bc0e38ef76fa255cd47e283: Waiting for close lock at 1675861380544Disabling compacts and flushes for region at 1675861380544Disabling writes for close at 1675861380544Writing region close event to WAL at 1675861380547 (+3 ms)Closed at 1675861380547 2023-02-08 13:03:01,636 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:01,636 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:01,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-08 13:03:01,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-08 13:03:01,648 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:01,648 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:01,649 INFO [Listener at localhost/41037] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-08 13:03:01,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-08 13:03:01,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-08 13:03:01,663 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861381662"}]},"ts":"1675861381662"} 2023-02-08 13:03:01,663 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:01,663 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:01,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 13:03:01,665 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-08 13:03:01,667 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-08 13:03:01,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7c6e8f9ce48294c939364df74fd31b84, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4e6088dbda8e673c8279ecc67bbf1b4a, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5dc36048c90a7ebfa122973d7d2b957e, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a999f4c483c2e332d2532c44631561ce, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=53392eb0fdd708840594d850c5b02119, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=407e898b138d86648b3d6ad809a016b7, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=34ed898d6bc0e38ef76fa255cd47e283, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=646a3c1c46bd5c27e7bf1e3251adfca3, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=20c9d781a81b7de50e17d9cfcc362f04, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e8458dcff1a335275f5bab3da4be4ba8, UNASSIGN}] 2023-02-08 13:03:01,692 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=407e898b138d86648b3d6ad809a016b7, UNASSIGN 2023-02-08 13:03:01,693 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=53392eb0fdd708840594d850c5b02119, UNASSIGN 2023-02-08 13:03:01,693 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a999f4c483c2e332d2532c44631561ce, UNASSIGN 2023-02-08 13:03:01,694 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=34ed898d6bc0e38ef76fa255cd47e283, UNASSIGN 2023-02-08 13:03:01,694 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=407e898b138d86648b3d6ad809a016b7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:03:01,694 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861381694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861381694"}]},"ts":"1675861381694"} 2023-02-08 13:03:01,694 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e8458dcff1a335275f5bab3da4be4ba8, UNASSIGN 2023-02-08 13:03:01,694 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=53392eb0fdd708840594d850c5b02119, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:03:01,695 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861381694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861381694"}]},"ts":"1675861381694"} 2023-02-08 13:03:01,695 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a999f4c483c2e332d2532c44631561ce, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:03:01,695 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=34ed898d6bc0e38ef76fa255cd47e283, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:03:01,696 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861381695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861381695"}]},"ts":"1675861381695"} 2023-02-08 13:03:01,695 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e8458dcff1a335275f5bab3da4be4ba8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:03:01,696 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861381695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861381695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861381695"}]},"ts":"1675861381695"} 2023-02-08 13:03:01,696 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861381695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861381695"}]},"ts":"1675861381695"} 2023-02-08 13:03:01,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=39, state=RUNNABLE; CloseRegionProcedure 407e898b138d86648b3d6ad809a016b7, server=jenkins-hbase4.apache.org,42029,1675861371000}] 2023-02-08 13:03:01,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=38, state=RUNNABLE; CloseRegionProcedure 53392eb0fdd708840594d850c5b02119, server=jenkins-hbase4.apache.org,45759,1675861370954}] 2023-02-08 13:03:01,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=40, state=RUNNABLE; CloseRegionProcedure 34ed898d6bc0e38ef76fa255cd47e283, server=jenkins-hbase4.apache.org,45759,1675861370954}] 2023-02-08 13:03:01,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure e8458dcff1a335275f5bab3da4be4ba8, server=jenkins-hbase4.apache.org,42029,1675861371000}] 2023-02-08 13:03:01,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=37, state=RUNNABLE; CloseRegionProcedure a999f4c483c2e332d2532c44631561ce, server=jenkins-hbase4.apache.org,42029,1675861371000}] 2023-02-08 13:03:01,708 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=20c9d781a81b7de50e17d9cfcc362f04, UNASSIGN 2023-02-08 13:03:01,709 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=646a3c1c46bd5c27e7bf1e3251adfca3, UNASSIGN 2023-02-08 13:03:01,710 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5dc36048c90a7ebfa122973d7d2b957e, UNASSIGN 2023-02-08 13:03:01,710 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=646a3c1c46bd5c27e7bf1e3251adfca3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:03:01,710 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=20c9d781a81b7de50e17d9cfcc362f04, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:03:01,710 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4e6088dbda8e673c8279ecc67bbf1b4a, UNASSIGN 2023-02-08 13:03:01,710 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381710"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861381710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861381710"}]},"ts":"1675861381710"} 2023-02-08 13:03:01,710 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381710"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861381710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861381710"}]},"ts":"1675861381710"} 2023-02-08 13:03:01,711 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=5dc36048c90a7ebfa122973d7d2b957e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:03:01,712 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861381711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861381711"}]},"ts":"1675861381711"} 2023-02-08 13:03:01,712 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=4e6088dbda8e673c8279ecc67bbf1b4a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:03:01,712 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381712"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861381712"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861381712"}]},"ts":"1675861381712"} 2023-02-08 13:03:01,712 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7c6e8f9ce48294c939364df74fd31b84, UNASSIGN 2023-02-08 13:03:01,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 20c9d781a81b7de50e17d9cfcc362f04, server=jenkins-hbase4.apache.org,45759,1675861370954}] 2023-02-08 13:03:01,720 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=7c6e8f9ce48294c939364df74fd31b84, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:03:01,720 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861381719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861381719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861381719"}]},"ts":"1675861381719"} 2023-02-08 13:03:01,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 646a3c1c46bd5c27e7bf1e3251adfca3, server=jenkins-hbase4.apache.org,42029,1675861371000}] 2023-02-08 13:03:01,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure 5dc36048c90a7ebfa122973d7d2b957e, server=jenkins-hbase4.apache.org,45759,1675861370954}] 2023-02-08 13:03:01,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure 4e6088dbda8e673c8279ecc67bbf1b4a, server=jenkins-hbase4.apache.org,45759,1675861370954}] 2023-02-08 13:03:01,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 7c6e8f9ce48294c939364df74fd31b84, server=jenkins-hbase4.apache.org,42029,1675861371000}] 2023-02-08 13:03:01,765 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:01,765 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:01,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 13:03:01,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:03:01,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e8458dcff1a335275f5bab3da4be4ba8, disabling compactions & flushes 2023-02-08 13:03:01,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:03:01,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:03:01,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4e6088dbda8e673c8279ecc67bbf1b4a, disabling compactions & flushes 2023-02-08 13:03:01,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:03:01,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:03:01,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. after waiting 0 ms 2023-02-08 13:03:01,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:03:01,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:03:01,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. after waiting 0 ms 2023-02-08 13:03:01,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:03:01,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 13:03:01,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8. 2023-02-08 13:03:01,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e8458dcff1a335275f5bab3da4be4ba8: Waiting for close lock at 1675861381859Running coprocessor pre-close hooks at 1675861381859Disabling compacts and flushes for region at 1675861381859Disabling writes for close at 1675861381860 (+1 ms)Writing region close event to WAL at 1675861381860Running coprocessor post-close hooks at 1675861381878 (+18 ms)Closed at 1675861381879 (+1 ms) 2023-02-08 13:03:01,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:03:01,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:03:01,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 646a3c1c46bd5c27e7bf1e3251adfca3, disabling compactions & flushes 2023-02-08 13:03:01,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:03:01,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:03:01,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. after waiting 0 ms 2023-02-08 13:03:01,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:03:01,882 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e8458dcff1a335275f5bab3da4be4ba8, regionState=CLOSED 2023-02-08 13:03:01,883 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861381882"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861381882"}]},"ts":"1675861381882"} 2023-02-08 13:03:01,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:01,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a. 2023-02-08 13:03:01,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4e6088dbda8e673c8279ecc67bbf1b4a: Waiting for close lock at 1675861381859Running coprocessor pre-close hooks at 1675861381859Disabling compacts and flushes for region at 1675861381859Disabling writes for close at 1675861381860 (+1 ms)Writing region close event to WAL at 1675861381877 (+17 ms)Running coprocessor post-close hooks at 1675861381887 (+10 ms)Closed at 1675861381887 2023-02-08 13:03:01,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:03:01,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:03:01,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5dc36048c90a7ebfa122973d7d2b957e, disabling compactions & flushes 2023-02-08 13:03:01,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:03:01,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:03:01,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. after waiting 0 ms 2023-02-08 13:03:01,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:03:01,890 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=4e6088dbda8e673c8279ecc67bbf1b4a, regionState=CLOSED 2023-02-08 13:03:01,890 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861381890"}]},"ts":"1675861381890"} 2023-02-08 13:03:01,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-08 13:03:01,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure e8458dcff1a335275f5bab3da4be4ba8, server=jenkins-hbase4.apache.org,42029,1675861371000 in 183 msec 2023-02-08 13:03:01,893 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e8458dcff1a335275f5bab3da4be4ba8, UNASSIGN in 220 msec 2023-02-08 13:03:01,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-08 13:03:01,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure 4e6088dbda8e673c8279ecc67bbf1b4a, server=jenkins-hbase4.apache.org,45759,1675861370954 in 171 msec 2023-02-08 13:03:01,897 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4e6088dbda8e673c8279ecc67bbf1b4a, UNASSIGN in 226 msec 2023-02-08 13:03:01,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:01,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3. 2023-02-08 13:03:01,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 646a3c1c46bd5c27e7bf1e3251adfca3: Waiting for close lock at 1675861381882Running coprocessor pre-close hooks at 1675861381882Disabling compacts and flushes for region at 1675861381882Disabling writes for close at 1675861381882Writing region close event to WAL at 1675861381886 (+4 ms)Running coprocessor post-close hooks at 1675861381899 (+13 ms)Closed at 1675861381900 (+1 ms) 2023-02-08 13:03:01,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:03:01,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 407e898b138d86648b3d6ad809a016b7 2023-02-08 13:03:01,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 407e898b138d86648b3d6ad809a016b7, disabling compactions & flushes 2023-02-08 13:03:01,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:03:01,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:03:01,902 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=646a3c1c46bd5c27e7bf1e3251adfca3, regionState=CLOSED 2023-02-08 13:03:01,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. after waiting 0 ms 2023-02-08 13:03:01,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:03:01,903 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861381902"}]},"ts":"1675861381902"} 2023-02-08 13:03:01,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:01,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e. 2023-02-08 13:03:01,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5dc36048c90a7ebfa122973d7d2b957e: Waiting for close lock at 1675861381889Running coprocessor pre-close hooks at 1675861381889Disabling compacts and flushes for region at 1675861381889Disabling writes for close at 1675861381890 (+1 ms)Writing region close event to WAL at 1675861381900 (+10 ms)Running coprocessor post-close hooks at 1675861381906 (+6 ms)Closed at 1675861381907 (+1 ms) 2023-02-08 13:03:01,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:03:01,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:03:01,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 34ed898d6bc0e38ef76fa255cd47e283, disabling compactions & flushes 2023-02-08 13:03:01,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:03:01,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:03:01,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. after waiting 0 ms 2023-02-08 13:03:01,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:03:01,913 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=5dc36048c90a7ebfa122973d7d2b957e, regionState=CLOSED 2023-02-08 13:03:01,914 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381913"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861381913"}]},"ts":"1675861381913"} 2023-02-08 13:03:01,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-08 13:03:01,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 646a3c1c46bd5c27e7bf1e3251adfca3, server=jenkins-hbase4.apache.org,42029,1675861371000 in 185 msec 2023-02-08 13:03:01,917 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=646a3c1c46bd5c27e7bf1e3251adfca3, UNASSIGN in 246 msec 2023-02-08 13:03:01,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-08 13:03:01,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure 5dc36048c90a7ebfa122973d7d2b957e, server=jenkins-hbase4.apache.org,45759,1675861370954 in 195 msec 2023-02-08 13:03:01,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5dc36048c90a7ebfa122973d7d2b957e, UNASSIGN in 250 msec 2023-02-08 13:03:01,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:01,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7. 2023-02-08 13:03:01,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 407e898b138d86648b3d6ad809a016b7: Waiting for close lock at 1675861381902Running coprocessor pre-close hooks at 1675861381902Disabling compacts and flushes for region at 1675861381902Disabling writes for close at 1675861381903 (+1 ms)Writing region close event to WAL at 1675861381908 (+5 ms)Running coprocessor post-close hooks at 1675861381928 (+20 ms)Closed at 1675861381929 (+1 ms) 2023-02-08 13:03:01,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:01,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283. 2023-02-08 13:03:01,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 34ed898d6bc0e38ef76fa255cd47e283: Waiting for close lock at 1675861381913Running coprocessor pre-close hooks at 1675861381913Disabling compacts and flushes for region at 1675861381913Disabling writes for close at 1675861381913Writing region close event to WAL at 1675861381927 (+14 ms)Running coprocessor post-close hooks at 1675861381932 (+5 ms)Closed at 1675861381932 2023-02-08 13:03:01,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 407e898b138d86648b3d6ad809a016b7 2023-02-08 13:03:01,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a999f4c483c2e332d2532c44631561ce 2023-02-08 13:03:01,935 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=407e898b138d86648b3d6ad809a016b7, regionState=CLOSED 2023-02-08 13:03:01,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a999f4c483c2e332d2532c44631561ce, disabling compactions & flushes 2023-02-08 13:03:01,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:03:01,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:03:01,935 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381935"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861381935"}]},"ts":"1675861381935"} 2023-02-08 13:03:01,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. after waiting 0 ms 2023-02-08 13:03:01,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:03:01,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:03:01,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:03:01,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 20c9d781a81b7de50e17d9cfcc362f04, disabling compactions & flushes 2023-02-08 13:03:01,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:03:01,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:03:01,937 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=34ed898d6bc0e38ef76fa255cd47e283, regionState=CLOSED 2023-02-08 13:03:01,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. after waiting 0 ms 2023-02-08 13:03:01,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:03:01,937 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381937"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861381937"}]},"ts":"1675861381937"} 2023-02-08 13:03:01,940 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=39 2023-02-08 13:03:01,940 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=39, state=SUCCESS; CloseRegionProcedure 407e898b138d86648b3d6ad809a016b7, server=jenkins-hbase4.apache.org,42029,1675861371000 in 241 msec 2023-02-08 13:03:01,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=407e898b138d86648b3d6ad809a016b7, UNASSIGN in 271 msec 2023-02-08 13:03:01,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=40 2023-02-08 13:03:01,944 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=40, state=SUCCESS; CloseRegionProcedure 34ed898d6bc0e38ef76fa255cd47e283, server=jenkins-hbase4.apache.org,45759,1675861370954 in 237 msec 2023-02-08 13:03:01,948 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=34ed898d6bc0e38ef76fa255cd47e283, UNASSIGN in 275 msec 2023-02-08 13:03:01,967 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:01,967 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:01,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 13:03:01,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:01,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:01,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04. 2023-02-08 13:03:01,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 20c9d781a81b7de50e17d9cfcc362f04: Waiting for close lock at 1675861381937Running coprocessor pre-close hooks at 1675861381937Disabling compacts and flushes for region at 1675861381937Disabling writes for close at 1675861381937Writing region close event to WAL at 1675861381971 (+34 ms)Running coprocessor post-close hooks at 1675861381978 (+7 ms)Closed at 1675861381979 (+1 ms) 2023-02-08 13:03:01,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce. 2023-02-08 13:03:01,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a999f4c483c2e332d2532c44631561ce: Waiting for close lock at 1675861381935Running coprocessor pre-close hooks at 1675861381935Disabling compacts and flushes for region at 1675861381935Disabling writes for close at 1675861381936 (+1 ms)Writing region close event to WAL at 1675861381972 (+36 ms)Running coprocessor post-close hooks at 1675861381979 (+7 ms)Closed at 1675861381980 (+1 ms) 2023-02-08 13:03:01,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:03:01,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 53392eb0fdd708840594d850c5b02119 2023-02-08 13:03:01,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 53392eb0fdd708840594d850c5b02119, disabling compactions & flushes 2023-02-08 13:03:01,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:03:01,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:03:01,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. after waiting 0 ms 2023-02-08 13:03:01,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:03:01,982 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=20c9d781a81b7de50e17d9cfcc362f04, regionState=CLOSED 2023-02-08 13:03:01,982 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381982"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861381982"}]},"ts":"1675861381982"} 2023-02-08 13:03:01,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a999f4c483c2e332d2532c44631561ce 2023-02-08 13:03:01,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:03:01,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7c6e8f9ce48294c939364df74fd31b84, disabling compactions & flushes 2023-02-08 13:03:01,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:03:01,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:03:01,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. after waiting 0 ms 2023-02-08 13:03:01,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:03:01,983 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a999f4c483c2e332d2532c44631561ce, regionState=CLOSED 2023-02-08 13:03:01,984 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861381983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861381983"}]},"ts":"1675861381983"} 2023-02-08 13:03:01,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-08 13:03:01,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 20c9d781a81b7de50e17d9cfcc362f04, server=jenkins-hbase4.apache.org,45759,1675861370954 in 266 msec 2023-02-08 13:03:01,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=37 2023-02-08 13:03:01,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=37, state=SUCCESS; CloseRegionProcedure a999f4c483c2e332d2532c44631561ce, server=jenkins-hbase4.apache.org,42029,1675861371000 in 280 msec 2023-02-08 13:03:01,990 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=20c9d781a81b7de50e17d9cfcc362f04, UNASSIGN in 318 msec 2023-02-08 13:03:01,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a999f4c483c2e332d2532c44631561ce, UNASSIGN in 320 msec 2023-02-08 13:03:02,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 13:03:02,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84. 2023-02-08 13:03:02,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7c6e8f9ce48294c939364df74fd31b84: Waiting for close lock at 1675861381983Running coprocessor pre-close hooks at 1675861381983Disabling compacts and flushes for region at 1675861381983Disabling writes for close at 1675861381983Writing region close event to WAL at 1675861381992 (+9 ms)Running coprocessor post-close hooks at 1675861382001 (+9 ms)Closed at 1675861382002 (+1 ms) 2023-02-08 13:03:02,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:03:02,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:02,005 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=7c6e8f9ce48294c939364df74fd31b84, regionState=CLOSED 2023-02-08 13:03:02,005 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861382005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861382005"}]},"ts":"1675861382005"} 2023-02-08 13:03:02,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119. 2023-02-08 13:03:02,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 53392eb0fdd708840594d850c5b02119: Waiting for close lock at 1675861381982Running coprocessor pre-close hooks at 1675861381982Disabling compacts and flushes for region at 1675861381982Disabling writes for close at 1675861381982Writing region close event to WAL at 1675861381999 (+17 ms)Running coprocessor post-close hooks at 1675861382005 (+6 ms)Closed at 1675861382006 (+1 ms) 2023-02-08 13:03:02,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 53392eb0fdd708840594d850c5b02119 2023-02-08 13:03:02,009 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=53392eb0fdd708840594d850c5b02119, regionState=CLOSED 2023-02-08 13:03:02,009 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861382009"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861382009"}]},"ts":"1675861382009"} 2023-02-08 13:03:02,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-08 13:03:02,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 7c6e8f9ce48294c939364df74fd31b84, server=jenkins-hbase4.apache.org,42029,1675861371000 in 285 msec 2023-02-08 13:03:02,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7c6e8f9ce48294c939364df74fd31b84, UNASSIGN in 342 msec 2023-02-08 13:03:02,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=38 2023-02-08 13:03:02,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=38, state=SUCCESS; CloseRegionProcedure 53392eb0fdd708840594d850c5b02119, server=jenkins-hbase4.apache.org,45759,1675861370954 in 314 msec 2023-02-08 13:03:02,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=33 2023-02-08 13:03:02,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=53392eb0fdd708840594d850c5b02119, UNASSIGN in 345 msec 2023-02-08 13:03:02,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861382017"}]},"ts":"1675861382017"} 2023-02-08 13:03:02,019 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-08 13:03:02,022 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-08 13:03:02,025 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 372 msec 2023-02-08 13:03:02,270 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:02,270 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:02,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 13:03:02,272 INFO [Listener at localhost/41037] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-08 13:03:02,273 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:02,273 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:02,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-08 13:03:02,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-08 13:03:02,289 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 13:03:02,290 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 13:03:02,291 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:02,291 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:02,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-08 13:03:02,306 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:03:02,306 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:03:02,306 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119 2023-02-08 13:03:02,306 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:03:02,306 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7 2023-02-08 13:03:02,306 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:03:02,306 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce 2023-02-08 13:03:02,306 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:03:02,313 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84/f1, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84/f2, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84/recovered.edits] 2023-02-08 13:03:02,314 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/recovered.edits] 2023-02-08 13:03:02,314 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/recovered.edits] 2023-02-08 13:03:02,315 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/recovered.edits] 2023-02-08 13:03:02,315 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/recovered.edits] 2023-02-08 13:03:02,315 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/recovered.edits] 2023-02-08 13:03:02,316 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/recovered.edits] 2023-02-08 13:03:02,318 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/recovered.edits] 2023-02-08 13:03:02,328 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1/a01d6dc41f7745c4810d7a4e46c0efc3 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1/a01d6dc41f7745c4810d7a4e46c0efc3 2023-02-08 13:03:02,328 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1/ab70648fd9c24b7bb875989da8a507b7 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1/ab70648fd9c24b7bb875989da8a507b7 2023-02-08 13:03:02,328 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1/5e48cf6c7d5746f1a7b2d7f766ba8bc8 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1/5e48cf6c7d5746f1a7b2d7f766ba8bc8 2023-02-08 13:03:02,328 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1/4905b1d7fd78479cac3fdd7918fd2e25 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1/4905b1d7fd78479cac3fdd7918fd2e25 2023-02-08 13:03:02,331 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1/fe9c6d6920ac4be280a86ab514a17028 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f1/fe9c6d6920ac4be280a86ab514a17028 2023-02-08 13:03:02,331 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1/88056020e3d24ae0b2b65116285eb2a2 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1/88056020e3d24ae0b2b65116285eb2a2 2023-02-08 13:03:02,332 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1/c19037465ce9483dabc0ee14319f7d6d to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f1/c19037465ce9483dabc0ee14319f7d6d 2023-02-08 13:03:02,332 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1/75bd0c5ff5504e39b20aa5f05d728b85 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1/75bd0c5ff5504e39b20aa5f05d728b85 2023-02-08 13:03:02,332 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1/f06814bdc27c43ab802ac0786229f47c to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f1/f06814bdc27c43ab802ac0786229f47c 2023-02-08 13:03:02,332 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1/ec0a53e2598f4a1888bedfe3182dcf65 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f1/ec0a53e2598f4a1888bedfe3182dcf65 2023-02-08 13:03:02,332 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84/recovered.edits/6.seqid to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84/recovered.edits/6.seqid 2023-02-08 13:03:02,333 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/7c6e8f9ce48294c939364df74fd31b84 2023-02-08 13:03:02,334 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:03:02,335 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1/ef8a293675fb42bca6cc8eb4e558b89f to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f1/ef8a293675fb42bca6cc8eb4e558b89f 2023-02-08 13:03:02,335 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1/ca9047427e1e4b28bd95a3097888bfaa to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f1/ca9047427e1e4b28bd95a3097888bfaa 2023-02-08 13:03:02,339 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/recovered.edits] 2023-02-08 13:03:02,340 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2/6d7cb531319144d79eb17784213e3289 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2/6d7cb531319144d79eb17784213e3289 2023-02-08 13:03:02,341 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2/4365f72439254dc68c93f7104c850c40 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2/4365f72439254dc68c93f7104c850c40 2023-02-08 13:03:02,341 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2/80df64f872ff403fb94bf074a53ef9e0 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2/80df64f872ff403fb94bf074a53ef9e0 2023-02-08 13:03:02,343 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2/91216766b9de40e8890bbdc670be5dd2 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2/91216766b9de40e8890bbdc670be5dd2 2023-02-08 13:03:02,343 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2/0b6ea65d235e41e492246b8a4cd24ef3 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2/0b6ea65d235e41e492246b8a4cd24ef3 2023-02-08 13:03:02,344 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2/701d8d4cb0f1455693a7f36fc393e919 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/f2/701d8d4cb0f1455693a7f36fc393e919 2023-02-08 13:03:02,345 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2/98deec41e5aa4834a00c8934b0f882ba to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/f2/98deec41e5aa4834a00c8934b0f882ba 2023-02-08 13:03:02,345 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2/6b2d9536928e44e5a38652826334432f to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/f2/6b2d9536928e44e5a38652826334432f 2023-02-08 13:03:02,345 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2/ceea91daa12048daaf625b84c4d6bded to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2/ceea91daa12048daaf625b84c4d6bded 2023-02-08 13:03:02,345 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1/7cadb1364b10432eac4d26a65c3faaaf to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1/7cadb1364b10432eac4d26a65c3faaaf 2023-02-08 13:03:02,347 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2/520e615c81e74caf9750901c7cc8a4e7 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/f2/520e615c81e74caf9750901c7cc8a4e7 2023-02-08 13:03:02,348 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2/c5ba6263294a410186948d443da0ac57 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/f2/c5ba6263294a410186948d443da0ac57 2023-02-08 13:03:02,349 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1/da4a663f488947d2b8100ca5604f17a5 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f1/da4a663f488947d2b8100ca5604f17a5 2023-02-08 13:03:02,349 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2/e23a88fadc3447878ceb5de90642291e to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/f2/e23a88fadc3447878ceb5de90642291e 2023-02-08 13:03:02,350 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1/869b378611884fde84a1b6d9712f4204 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1/869b378611884fde84a1b6d9712f4204 2023-02-08 13:03:02,355 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/recovered.edits/12.seqid to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e/recovered.edits/12.seqid 2023-02-08 13:03:02,356 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1/fcd241950ddb4edaaf1ca20d1bce234e to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f1/fcd241950ddb4edaaf1ca20d1bce234e 2023-02-08 13:03:02,356 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/recovered.edits/12.seqid to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7/recovered.edits/12.seqid 2023-02-08 13:03:02,356 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/5dc36048c90a7ebfa122973d7d2b957e 2023-02-08 13:03:02,356 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:03:02,357 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/recovered.edits/12.seqid to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3/recovered.edits/12.seqid 2023-02-08 13:03:02,359 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/407e898b138d86648b3d6ad809a016b7 2023-02-08 13:03:02,359 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/646a3c1c46bd5c27e7bf1e3251adfca3 2023-02-08 13:03:02,359 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/recovered.edits/12.seqid to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce/recovered.edits/12.seqid 2023-02-08 13:03:02,360 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/recovered.edits/12.seqid to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a/recovered.edits/12.seqid 2023-02-08 13:03:02,361 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/a999f4c483c2e332d2532c44631561ce 2023-02-08 13:03:02,361 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2/3235580977ce41119b0ef8465666d665 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2/3235580977ce41119b0ef8465666d665 2023-02-08 13:03:02,365 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/4e6088dbda8e673c8279ecc67bbf1b4a 2023-02-08 13:03:02,365 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/recovered.edits/12.seqid to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119/recovered.edits/12.seqid 2023-02-08 13:03:02,366 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/53392eb0fdd708840594d850c5b02119 2023-02-08 13:03:02,366 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8/f1, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8/f2, FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8/recovered.edits] 2023-02-08 13:03:02,368 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2/99df961875964972ba3f812eb3407032 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/f2/99df961875964972ba3f812eb3407032 2023-02-08 13:03:02,369 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2/0d8bb6006b844fb98a40003061efbdeb to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2/0d8bb6006b844fb98a40003061efbdeb 2023-02-08 13:03:02,372 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2/d763cb9566ff475e9bc84ff01992c579 to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/f2/d763cb9566ff475e9bc84ff01992c579 2023-02-08 13:03:02,374 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/recovered.edits/12.seqid to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283/recovered.edits/12.seqid 2023-02-08 13:03:02,375 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/34ed898d6bc0e38ef76fa255cd47e283 2023-02-08 13:03:02,377 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/recovered.edits/12.seqid to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04/recovered.edits/12.seqid 2023-02-08 13:03:02,377 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8/recovered.edits/6.seqid to hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/archive/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8/recovered.edits/6.seqid 2023-02-08 13:03:02,378 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/20c9d781a81b7de50e17d9cfcc362f04 2023-02-08 13:03:02,378 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/.tmp/data/default/testWithMapReduce/e8458dcff1a335275f5bab3da4be4ba8 2023-02-08 13:03:02,378 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-08 13:03:02,381 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 13:03:02,392 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:02,393 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:02,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-08 13:03:02,414 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-08 13:03:02,418 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-08 13:03:02,419 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 13:03:02,419 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-08 13:03:02,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861382419"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:02,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861382419"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:02,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861382419"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:02,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861382419"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:02,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861382419"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:02,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861382419"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:02,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861382419"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:02,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861382419"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:02,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861382419"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:02,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861382419"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:02,423 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-08 13:03:02,423 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7c6e8f9ce48294c939364df74fd31b84, NAME => 'testWithMapReduce,,1675861373853.7c6e8f9ce48294c939364df74fd31b84.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 4e6088dbda8e673c8279ecc67bbf1b4a, NAME => 'testWithMapReduce,aaa,1675861373853.4e6088dbda8e673c8279ecc67bbf1b4a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 5dc36048c90a7ebfa122973d7d2b957e, NAME => 'testWithMapReduce,d\x84\x84,1675861373853.5dc36048c90a7ebfa122973d7d2b957e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => a999f4c483c2e332d2532c44631561ce, NAME => 'testWithMapReduce,g\xA7\xA7,1675861373853.a999f4c483c2e332d2532c44631561ce.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 53392eb0fdd708840594d850c5b02119, NAME => 'testWithMapReduce,j\xCA\xCA,1675861373853.53392eb0fdd708840594d850c5b02119.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 407e898b138d86648b3d6ad809a016b7, NAME => 'testWithMapReduce,m\xED\xED,1675861373853.407e898b138d86648b3d6ad809a016b7.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 34ed898d6bc0e38ef76fa255cd47e283, NAME => 'testWithMapReduce,q\x11\x10,1675861373853.34ed898d6bc0e38ef76fa255cd47e283.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 646a3c1c46bd5c27e7bf1e3251adfca3, NAME => 'testWithMapReduce,t43,1675861373853.646a3c1c46bd5c27e7bf1e3251adfca3.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 20c9d781a81b7de50e17d9cfcc362f04, NAME => 'testWithMapReduce,wWV,1675861373853.20c9d781a81b7de50e17d9cfcc362f04.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => e8458dcff1a335275f5bab3da4be4ba8, NAME => 'testWithMapReduce,zz{,1675861373853.e8458dcff1a335275f5bab3da4be4ba8.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-08 13:03:02,423 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-08 13:03:02,423 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675861382423"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:02,426 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-08 13:03:02,428 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 13:03:02,429 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 148 msec 2023-02-08 13:03:02,594 INFO [Listener at localhost/41037] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:02,595 INFO [Listener at localhost/41037] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:02,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33715] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-08 13:03:02,596 INFO [Listener at localhost/41037] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-08 13:03:02,596 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 13:03:02,597 INFO [Listener at localhost/41037] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 13:03:02,597 DEBUG [Listener at localhost/41037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b8ae91a to 127.0.0.1:64435 2023-02-08 13:03:02,597 DEBUG [Listener at localhost/41037] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:02,597 DEBUG [Listener at localhost/41037] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 13:03:02,597 DEBUG [Listener at localhost/41037] util.JVMClusterUtil(257): Found active master hash=2012977623, stopped=false 2023-02-08 13:03:02,597 INFO [Listener at localhost/41037] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33715,1675861369728 2023-02-08 13:03:02,600 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:02,600 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:02,600 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:02,600 INFO [Listener at localhost/41037] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 13:03:02,600 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:02,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:02,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:02,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:02,602 DEBUG [Listener at localhost/41037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x630bd2e7 to 127.0.0.1:64435 2023-02-08 13:03:02,602 DEBUG [Listener at localhost/41037] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:02,603 INFO [Listener at localhost/41037] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45759,1675861370954' ***** 2023-02-08 13:03:02,603 INFO [Listener at localhost/41037] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:02,603 INFO [Listener at localhost/41037] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42029,1675861371000' ***** 2023-02-08 13:03:02,603 INFO [Listener at localhost/41037] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:02,603 INFO [RS:0;jenkins-hbase4:45759] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:02,604 INFO [RS:0;jenkins-hbase4:45759] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:02,604 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:02,604 INFO [RS:0;jenkins-hbase4:45759] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:02,603 INFO [RS:1;jenkins-hbase4:42029] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:02,604 INFO [RS:1;jenkins-hbase4:42029] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:02,604 INFO [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(3304): Received CLOSE for 4d6569ef9a17357359db3c109d2811f5 2023-02-08 13:03:02,605 INFO [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:03:02,605 DEBUG [RS:0;jenkins-hbase4:45759] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03fb9627 to 127.0.0.1:64435 2023-02-08 13:03:02,605 DEBUG [RS:0;jenkins-hbase4:45759] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:02,604 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:02,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4d6569ef9a17357359db3c109d2811f5, disabling compactions & flushes 2023-02-08 13:03:02,605 INFO [RS:1;jenkins-hbase4:42029] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:02,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. 2023-02-08 13:03:02,606 INFO [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 13:03:02,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. 2023-02-08 13:03:02,606 INFO [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:03:02,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. after waiting 0 ms 2023-02-08 13:03:02,606 DEBUG [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(1479): Online Regions={4d6569ef9a17357359db3c109d2811f5=hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5.} 2023-02-08 13:03:02,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. 2023-02-08 13:03:02,606 DEBUG [RS:1;jenkins-hbase4:42029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x037f54ad to 127.0.0.1:64435 2023-02-08 13:03:02,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4d6569ef9a17357359db3c109d2811f5 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 13:03:02,607 DEBUG [RS:1;jenkins-hbase4:42029] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:02,607 INFO [RS:1;jenkins-hbase4:42029] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:02,607 INFO [RS:1;jenkins-hbase4:42029] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:02,607 INFO [RS:1;jenkins-hbase4:42029] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:02,607 INFO [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 13:03:02,607 INFO [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 13:03:02,607 DEBUG [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-08 13:03:02,608 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:03:02,608 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:03:02,608 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:03:02,608 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:03:02,608 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:03:02,608 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-08 13:03:02,609 DEBUG [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(1505): Waiting on 4d6569ef9a17357359db3c109d2811f5 2023-02-08 13:03:02,609 DEBUG [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 13:03:02,626 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/.tmp/info/ddcd164f025845989ad43da8b6685b27 2023-02-08 13:03:02,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ddcd164f025845989ad43da8b6685b27 2023-02-08 13:03:02,638 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:02,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/namespace/4d6569ef9a17357359db3c109d2811f5/.tmp/info/60c8d7c471ac4a7c8c39039f4b4d4597 2023-02-08 13:03:02,653 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:02,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/namespace/4d6569ef9a17357359db3c109d2811f5/.tmp/info/60c8d7c471ac4a7c8c39039f4b4d4597 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/namespace/4d6569ef9a17357359db3c109d2811f5/info/60c8d7c471ac4a7c8c39039f4b4d4597 2023-02-08 13:03:02,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/namespace/4d6569ef9a17357359db3c109d2811f5/info/60c8d7c471ac4a7c8c39039f4b4d4597, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 13:03:02,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4d6569ef9a17357359db3c109d2811f5 in 72ms, sequenceid=6, compaction requested=false 2023-02-08 13:03:02,684 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/.tmp/rep_barrier/dbe533951ac64448ab12d78e1ba73979 2023-02-08 13:03:02,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbe533951ac64448ab12d78e1ba73979 2023-02-08 13:03:02,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/namespace/4d6569ef9a17357359db3c109d2811f5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 13:03:02,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. 2023-02-08 13:03:02,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4d6569ef9a17357359db3c109d2811f5: Waiting for close lock at 1675861382605Running coprocessor pre-close hooks at 1675861382605Disabling compacts and flushes for region at 1675861382605Disabling writes for close at 1675861382606 (+1 ms)Obtaining lock to block concurrent updates at 1675861382607 (+1 ms)Preparing flush snapshotting stores in 4d6569ef9a17357359db3c109d2811f5 at 1675861382607Finished memstore snapshotting hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675861382607Flushing stores of hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. at 1675861382609 (+2 ms)Flushing 4d6569ef9a17357359db3c109d2811f5/info: creating writer at 1675861382609Flushing 4d6569ef9a17357359db3c109d2811f5/info: appending metadata at 1675861382612 (+3 ms)Flushing 4d6569ef9a17357359db3c109d2811f5/info: closing flushed file at 1675861382612Flushing 4d6569ef9a17357359db3c109d2811f5/info: reopening flushed file at 1675861382659 (+47 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4d6569ef9a17357359db3c109d2811f5 in 72ms, sequenceid=6, compaction requested=false at 1675861382679 (+20 ms)Writing region close event to WAL at 1675861382683 (+4 ms)Running coprocessor post-close hooks at 1675861382694 (+11 ms)Closed at 1675861382701 (+7 ms) 2023-02-08 13:03:02,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675861373014.4d6569ef9a17357359db3c109d2811f5. 2023-02-08 13:03:02,728 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/.tmp/table/ce05eb8273a54b79997f89047d4df230 2023-02-08 13:03:02,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce05eb8273a54b79997f89047d4df230 2023-02-08 13:03:02,735 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/.tmp/info/ddcd164f025845989ad43da8b6685b27 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/info/ddcd164f025845989ad43da8b6685b27 2023-02-08 13:03:02,741 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ddcd164f025845989ad43da8b6685b27 2023-02-08 13:03:02,741 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/info/ddcd164f025845989ad43da8b6685b27, entries=30, sequenceid=57, filesize=7.9 K 2023-02-08 13:03:02,742 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/.tmp/rep_barrier/dbe533951ac64448ab12d78e1ba73979 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/rep_barrier/dbe533951ac64448ab12d78e1ba73979 2023-02-08 13:03:02,747 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbe533951ac64448ab12d78e1ba73979 2023-02-08 13:03:02,747 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/rep_barrier/dbe533951ac64448ab12d78e1ba73979, entries=10, sequenceid=57, filesize=5.9 K 2023-02-08 13:03:02,748 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/.tmp/table/ce05eb8273a54b79997f89047d4df230 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/table/ce05eb8273a54b79997f89047d4df230 2023-02-08 13:03:02,755 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce05eb8273a54b79997f89047d4df230 2023-02-08 13:03:02,755 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/table/ce05eb8273a54b79997f89047d4df230, entries=13, sequenceid=57, filesize=5.9 K 2023-02-08 13:03:02,756 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 148ms, sequenceid=57, compaction requested=false 2023-02-08 13:03:02,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-08 13:03:02,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 13:03:02,767 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:02,767 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861382607Running coprocessor pre-close hooks at 1675861382607Disabling compacts and flushes for region at 1675861382607Disabling writes for close at 1675861382608 (+1 ms)Obtaining lock to block concurrent updates at 1675861382608Preparing flush snapshotting stores in 1588230740 at 1675861382608Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1675861382608Flushing stores of hbase:meta,,1.1588230740 at 1675861382609 (+1 ms)Flushing 1588230740/info: creating writer at 1675861382609Flushing 1588230740/info: appending metadata at 1675861382614 (+5 ms)Flushing 1588230740/info: closing flushed file at 1675861382614Flushing 1588230740/rep_barrier: creating writer at 1675861382636 (+22 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675861382643 (+7 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675861382643Flushing 1588230740/table: creating writer at 1675861382690 (+47 ms)Flushing 1588230740/table: appending metadata at 1675861382702 (+12 ms)Flushing 1588230740/table: closing flushed file at 1675861382702Flushing 1588230740/info: reopening flushed file at 1675861382736 (+34 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675861382742 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1675861382749 (+7 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 148ms, sequenceid=57, compaction requested=false at 1675861382756 (+7 ms)Writing region close event to WAL at 1675861382762 (+6 ms)Running coprocessor post-close hooks at 1675861382766 (+4 ms)Closed at 1675861382767 (+1 ms) 2023-02-08 13:03:02,768 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:02,809 INFO [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45759,1675861370954; all regions closed. 2023-02-08 13:03:02,809 INFO [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42029,1675861371000; all regions closed. 2023-02-08 13:03:02,820 DEBUG [RS:0;jenkins-hbase4:45759] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/oldWALs 2023-02-08 13:03:02,820 DEBUG [RS:1;jenkins-hbase4:42029] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/oldWALs 2023-02-08 13:03:02,820 INFO [RS:1;jenkins-hbase4:42029] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42029%2C1675861371000.meta:.meta(num 1675861372751) 2023-02-08 13:03:02,820 INFO [RS:0;jenkins-hbase4:45759] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45759%2C1675861370954:(num 1675861373465) 2023-02-08 13:03:02,820 DEBUG [RS:0;jenkins-hbase4:45759] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:02,820 INFO [RS:0;jenkins-hbase4:45759] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:02,821 INFO [RS:0;jenkins-hbase4:45759] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:02,821 INFO [RS:0;jenkins-hbase4:45759] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:02,821 INFO [RS:0;jenkins-hbase4:45759] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:02,821 INFO [RS:0;jenkins-hbase4:45759] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:02,822 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:02,822 INFO [RS:0;jenkins-hbase4:45759] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45759 2023-02-08 13:03:02,828 DEBUG [RS:1;jenkins-hbase4:42029] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/oldWALs 2023-02-08 13:03:02,828 INFO [RS:1;jenkins-hbase4:42029] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42029%2C1675861371000:(num 1675861373466) 2023-02-08 13:03:02,828 DEBUG [RS:1;jenkins-hbase4:42029] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:02,828 INFO [RS:1;jenkins-hbase4:42029] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:02,828 INFO [RS:1;jenkins-hbase4:42029] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:02,829 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:02,829 INFO [RS:1;jenkins-hbase4:42029] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42029 2023-02-08 13:03:02,833 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:03:02,834 ERROR [Listener at localhost/41037-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f26a563 rejected from java.util.concurrent.ThreadPoolExecutor@1b19325f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:02,834 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:02,834 ERROR [Listener at localhost/41037-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4528bd95 rejected from java.util.concurrent.ThreadPoolExecutor@1b19325f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:02,834 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45759,1675861370954 2023-02-08 13:03:02,834 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:02,834 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:02,835 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:03:02,835 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42029,1675861371000 2023-02-08 13:03:02,835 ERROR [Listener at localhost/41037-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3d56598a rejected from java.util.concurrent.ThreadPoolExecutor@1b19325f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:02,835 ERROR [Listener at localhost/41037-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13ab6691 rejected from java.util.concurrent.ThreadPoolExecutor@1794e03c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:02,837 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45759,1675861370954] 2023-02-08 13:03:02,837 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45759,1675861370954; numProcessing=1 2023-02-08 13:03:02,838 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45759,1675861370954 already deleted, retry=false 2023-02-08 13:03:02,838 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45759,1675861370954 expired; onlineServers=1 2023-02-08 13:03:02,838 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42029,1675861371000] 2023-02-08 13:03:02,838 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42029,1675861371000; numProcessing=2 2023-02-08 13:03:02,839 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42029,1675861371000 already deleted, retry=false 2023-02-08 13:03:02,839 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42029,1675861371000 expired; onlineServers=0 2023-02-08 13:03:02,839 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33715,1675861369728' ***** 2023-02-08 13:03:02,839 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 13:03:02,840 DEBUG [M:0;jenkins-hbase4:33715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36c693ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:02,840 INFO [M:0;jenkins-hbase4:33715] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33715,1675861369728 2023-02-08 13:03:02,840 INFO [M:0;jenkins-hbase4:33715] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33715,1675861369728; all regions closed. 2023-02-08 13:03:02,840 DEBUG [M:0;jenkins-hbase4:33715] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:02,840 DEBUG [M:0;jenkins-hbase4:33715] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 13:03:02,840 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 13:03:02,840 DEBUG [M:0;jenkins-hbase4:33715] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 13:03:02,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861372230] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861372230,5,FailOnTimeoutGroup] 2023-02-08 13:03:02,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861372230] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861372230,5,FailOnTimeoutGroup] 2023-02-08 13:03:02,840 INFO [M:0;jenkins-hbase4:33715] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 13:03:02,842 INFO [M:0;jenkins-hbase4:33715] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 13:03:02,843 INFO [M:0;jenkins-hbase4:33715] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 13:03:02,843 DEBUG [M:0;jenkins-hbase4:33715] master.HMaster(1502): Stopping service threads 2023-02-08 13:03:02,843 INFO [M:0;jenkins-hbase4:33715] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 13:03:02,843 ERROR [M:0;jenkins-hbase4:33715] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-08 13:03:02,844 INFO [M:0;jenkins-hbase4:33715] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 13:03:02,844 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 13:03:02,846 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:02,847 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:02,847 DEBUG [M:0;jenkins-hbase4:33715] zookeeper.ZKUtil(398): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 13:03:02,847 WARN [M:0;jenkins-hbase4:33715] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 13:03:02,847 INFO [M:0;jenkins-hbase4:33715] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 13:03:02,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:02,847 INFO [M:0;jenkins-hbase4:33715] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 13:03:02,848 DEBUG [M:0;jenkins-hbase4:33715] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:03:02,848 INFO [M:0;jenkins-hbase4:33715] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:02,848 DEBUG [M:0;jenkins-hbase4:33715] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:02,848 DEBUG [M:0;jenkins-hbase4:33715] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:03:02,848 DEBUG [M:0;jenkins-hbase4:33715] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:02,848 INFO [M:0;jenkins-hbase4:33715] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.24 KB heapSize=192.16 KB 2023-02-08 13:03:02,875 INFO [M:0;jenkins-hbase4:33715] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.24 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9361117623f143bf8fef62c221bd2e98 2023-02-08 13:03:02,890 DEBUG [M:0;jenkins-hbase4:33715] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9361117623f143bf8fef62c221bd2e98 as hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9361117623f143bf8fef62c221bd2e98 2023-02-08 13:03:02,895 INFO [M:0;jenkins-hbase4:33715] regionserver.HStore(1080): Added hdfs://localhost:46787/user/jenkins/test-data/ce1c9090-b375-7269-2e7b-9855271108a7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9361117623f143bf8fef62c221bd2e98, entries=53, sequenceid=357, filesize=10.4 K 2023-02-08 13:03:02,897 INFO [M:0;jenkins-hbase4:33715] regionserver.HRegion(2947): Finished flush of dataSize ~159.24 KB/163064, heapSize ~192.14 KB/196752, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 49ms, sequenceid=357, compaction requested=false 2023-02-08 13:03:02,901 INFO [M:0;jenkins-hbase4:33715] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:02,901 DEBUG [M:0;jenkins-hbase4:33715] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861382848Disabling compacts and flushes for region at 1675861382848Disabling writes for close at 1675861382848Obtaining lock to block concurrent updates at 1675861382848Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675861382848Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163064, getHeapSize=196752, getOffHeapSize=0, getCellsCount=442 at 1675861382849 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675861382849Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675861382850 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675861382854 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675861382854Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675861382891 (+37 ms)Finished flush of dataSize ~159.24 KB/163064, heapSize ~192.14 KB/196752, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 49ms, sequenceid=357, compaction requested=false at 1675861382897 (+6 ms)Writing region close event to WAL at 1675861382901 (+4 ms)Closed at 1675861382901 2023-02-08 13:03:02,905 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:02,905 INFO [M:0;jenkins-hbase4:33715] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 13:03:02,906 INFO [M:0;jenkins-hbase4:33715] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33715 2023-02-08 13:03:02,909 DEBUG [M:0;jenkins-hbase4:33715] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33715,1675861369728 already deleted, retry=false 2023-02-08 13:03:03,101 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:03,102 INFO [M:0;jenkins-hbase4:33715] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33715,1675861369728; zookeeper connection closed. 2023-02-08 13:03:03,102 ERROR [Listener at localhost/41037-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@319233c8 rejected from java.util.concurrent.ThreadPoolExecutor@244f6fba[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:03,102 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): master:33715-0x100340709d30000, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:03,102 ERROR [Listener at localhost/41037-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@400a54ef rejected from java.util.concurrent.ThreadPoolExecutor@244f6fba[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:03,202 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:03,202 INFO [RS:1;jenkins-hbase4:42029] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42029,1675861371000; zookeeper connection closed. 2023-02-08 13:03:03,202 ERROR [Listener at localhost/41037-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2b59bb5f rejected from java.util.concurrent.ThreadPoolExecutor@1794e03c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:03,202 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:42029-0x100340709d30002, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:03,202 ERROR [Listener at localhost/41037-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@53ab5606 rejected from java.util.concurrent.ThreadPoolExecutor@1794e03c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:03,202 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@27e8783d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@27e8783d 2023-02-08 13:03:03,302 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:03,302 INFO [RS:0;jenkins-hbase4:45759] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45759,1675861370954; zookeeper connection closed. 2023-02-08 13:03:03,302 ERROR [Listener at localhost/41037-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e708651 rejected from java.util.concurrent.ThreadPoolExecutor@1b19325f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:03,303 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@317a2056] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@317a2056 2023-02-08 13:03:03,303 DEBUG [Listener at localhost/41037-EventThread] zookeeper.ZKWatcher(600): regionserver:45759-0x100340709d30001, quorum=127.0.0.1:64435, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:03,303 ERROR [Listener at localhost/41037-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@265252bf rejected from java.util.concurrent.ThreadPoolExecutor@1b19325f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:03,303 INFO [Listener at localhost/41037] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 13:03:03,304 WARN [Listener at localhost/41037] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:03,307 INFO [Listener at localhost/41037] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:03,416 WARN [BP-1579745206-172.31.14.131-1675861366230 heartbeating to localhost/127.0.0.1:46787] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:03,416 WARN [BP-1579745206-172.31.14.131-1675861366230 heartbeating to localhost/127.0.0.1:46787] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1579745206-172.31.14.131-1675861366230 (Datanode Uuid 8ae96d40-2da7-4eda-98d1-1f1626223e29) service to localhost/127.0.0.1:46787 2023-02-08 13:03:03,418 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/cluster_ff6f2350-4145-97b2-4cd5-e4e4c6d6f903/dfs/data/data3/current/BP-1579745206-172.31.14.131-1675861366230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:03,419 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/cluster_ff6f2350-4145-97b2-4cd5-e4e4c6d6f903/dfs/data/data4/current/BP-1579745206-172.31.14.131-1675861366230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:03,421 WARN [Listener at localhost/41037] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:03,455 INFO [Listener at localhost/41037] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:03,559 WARN [BP-1579745206-172.31.14.131-1675861366230 heartbeating to localhost/127.0.0.1:46787] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:03,559 WARN [BP-1579745206-172.31.14.131-1675861366230 heartbeating to localhost/127.0.0.1:46787] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1579745206-172.31.14.131-1675861366230 (Datanode Uuid d5702c49-41c4-4c22-aae7-e95657a3213f) service to localhost/127.0.0.1:46787 2023-02-08 13:03:03,560 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/cluster_ff6f2350-4145-97b2-4cd5-e4e4c6d6f903/dfs/data/data1/current/BP-1579745206-172.31.14.131-1675861366230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:03,560 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/cluster_ff6f2350-4145-97b2-4cd5-e4e4c6d6f903/dfs/data/data2/current/BP-1579745206-172.31.14.131-1675861366230] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:03,595 INFO [Listener at localhost/41037] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:03,717 INFO [Listener at localhost/41037] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 13:03:03,802 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 13:03:03,819 INFO [Listener at localhost/41037] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:46787 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:46787 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: (jenkins-hbase4.apache.org,33715,1675861369728)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41037 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:46787 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:46787 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:46787 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46787 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:46787 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@b17785d java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=544 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=313 (was 168) - SystemLoadAverage LEAK? -, ProcessCount=203 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=4221 (was 5316) 2023-02-08 13:03:03,830 INFO [Listener at localhost/41037] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=544, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=203, AvailableMemoryMB=4221 2023-02-08 13:03:03,840 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/hadoop.log.dir so I do NOT create it in target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019 2023-02-08 13:03:03,841 WARN [Listener at localhost/41037] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/hadoop.log.dir Erasing configuration value by system value. 2023-02-08 13:03:03,841 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/hadoop.tmp.dir so I do NOT create it in target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019 2023-02-08 13:03:03,841 WARN [Listener at localhost/41037] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/59d049d4-68f1-dbd1-7642-45b2790634b5/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-08 13:03:03,841 DEBUG [Listener at localhost/41037] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019 2023-02-08 13:03:03,841 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 13:03:03,841 INFO [Listener at localhost/41037] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/cluster_87cc019f-226f-1138-9403-7c439ac87f49, deleteOnExit=true 2023-02-08 13:03:03,841 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 13:03:03,841 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/test.cache.data in system properties and HBase conf 2023-02-08 13:03:03,841 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 13:03:03,842 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/hadoop.log.dir in system properties and HBase conf 2023-02-08 13:03:03,842 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 13:03:03,842 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 13:03:03,842 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 13:03:03,842 DEBUG [Listener at localhost/41037] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 13:03:03,842 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:03:03,842 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:03:03,842 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 13:03:03,842 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:03:03,843 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 13:03:03,843 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 13:03:03,843 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:03:03,843 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:03:03,843 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 13:03:03,843 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/nfs.dump.dir in system properties and HBase conf 2023-02-08 13:03:03,843 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/java.io.tmpdir in system properties and HBase conf 2023-02-08 13:03:03,843 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:03:03,843 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 13:03:03,843 INFO [Listener at localhost/41037] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 13:03:03,847 WARN [Listener at localhost/41037] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:03:03,848 WARN [Listener at localhost/41037] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:03:03,893 WARN [Listener at localhost/41037] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:03,895 INFO [Listener at localhost/41037] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:03,900 INFO [Listener at localhost/41037] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/java.io.tmpdir/Jetty_localhost_45861_hdfs____.itezr8/webapp 2023-02-08 13:03:03,993 INFO [Listener at localhost/41037] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45861 2023-02-08 13:03:03,997 WARN [Listener at localhost/41037] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:03:03,997 WARN [Listener at localhost/41037] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:03:04,040 WARN [Listener at localhost/34987] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:04,059 WARN [Listener at localhost/34987] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:03:04,063 WARN [Listener at localhost/34987] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:04,064 INFO [Listener at localhost/34987] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:04,071 INFO [Listener at localhost/34987] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/java.io.tmpdir/Jetty_localhost_43081_datanode____.cwe767/webapp 2023-02-08 13:03:04,162 INFO [Listener at localhost/34987] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43081 2023-02-08 13:03:04,169 WARN [Listener at localhost/44989] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:04,186 WARN [Listener at localhost/44989] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:03:04,188 WARN [Listener at localhost/44989] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:04,189 INFO [Listener at localhost/44989] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:04,195 INFO [Listener at localhost/44989] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/java.io.tmpdir/Jetty_localhost_42051_datanode____kmjy45/webapp 2023-02-08 13:03:04,281 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x903cfad074039a5d: Processing first storage report for DS-33b62d5c-3934-47ec-aea7-e27a7fc5ded6 from datanode a2b4b595-877d-4235-872c-ee332af7f002 2023-02-08 13:03:04,281 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x903cfad074039a5d: from storage DS-33b62d5c-3934-47ec-aea7-e27a7fc5ded6 node DatanodeRegistration(127.0.0.1:43657, datanodeUuid=a2b4b595-877d-4235-872c-ee332af7f002, infoPort=44881, infoSecurePort=0, ipcPort=44989, storageInfo=lv=-57;cid=testClusterID;nsid=735512766;c=1675861383850), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:04,281 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x903cfad074039a5d: Processing first storage report for DS-76daa61c-b986-4019-9feb-635ceb69d8d9 from datanode a2b4b595-877d-4235-872c-ee332af7f002 2023-02-08 13:03:04,281 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x903cfad074039a5d: from storage DS-76daa61c-b986-4019-9feb-635ceb69d8d9 node DatanodeRegistration(127.0.0.1:43657, datanodeUuid=a2b4b595-877d-4235-872c-ee332af7f002, infoPort=44881, infoSecurePort=0, ipcPort=44989, storageInfo=lv=-57;cid=testClusterID;nsid=735512766;c=1675861383850), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:04,299 INFO [Listener at localhost/44989] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42051 2023-02-08 13:03:04,309 WARN [Listener at localhost/46349] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:04,415 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x781656e5335e90dc: Processing first storage report for DS-b343eddc-1faa-4120-b340-f576a4113863 from datanode 2692c8e0-80bd-47c6-9815-fe6439d4d5b1 2023-02-08 13:03:04,415 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x781656e5335e90dc: from storage DS-b343eddc-1faa-4120-b340-f576a4113863 node DatanodeRegistration(127.0.0.1:38373, datanodeUuid=2692c8e0-80bd-47c6-9815-fe6439d4d5b1, infoPort=39669, infoSecurePort=0, ipcPort=46349, storageInfo=lv=-57;cid=testClusterID;nsid=735512766;c=1675861383850), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:04,415 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x781656e5335e90dc: Processing first storage report for DS-32ed5643-72c0-4047-9d40-1af11754a88b from datanode 2692c8e0-80bd-47c6-9815-fe6439d4d5b1 2023-02-08 13:03:04,415 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x781656e5335e90dc: from storage DS-32ed5643-72c0-4047-9d40-1af11754a88b node DatanodeRegistration(127.0.0.1:38373, datanodeUuid=2692c8e0-80bd-47c6-9815-fe6439d4d5b1, infoPort=39669, infoSecurePort=0, ipcPort=46349, storageInfo=lv=-57;cid=testClusterID;nsid=735512766;c=1675861383850), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:04,422 DEBUG [Listener at localhost/46349] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019 2023-02-08 13:03:04,426 INFO [Listener at localhost/46349] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/cluster_87cc019f-226f-1138-9403-7c439ac87f49/zookeeper_0, clientPort=64909, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/cluster_87cc019f-226f-1138-9403-7c439ac87f49/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/cluster_87cc019f-226f-1138-9403-7c439ac87f49/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 13:03:04,427 INFO [Listener at localhost/46349] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64909 2023-02-08 13:03:04,427 INFO [Listener at localhost/46349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:04,429 INFO [Listener at localhost/46349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:04,452 INFO [Listener at localhost/46349] util.FSUtils(479): Created version file at hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1 with version=8 2023-02-08 13:03:04,452 INFO [Listener at localhost/46349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:04,453 INFO [Listener at localhost/46349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:04,455 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/hbase-staging 2023-02-08 13:03:04,459 INFO [Listener at localhost/46349] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:04,459 INFO [Listener at localhost/46349] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:04,460 INFO [Listener at localhost/46349] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:04,460 INFO [Listener at localhost/46349] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:04,460 INFO [Listener at localhost/46349] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:04,460 INFO [Listener at localhost/46349] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:04,460 INFO [Listener at localhost/46349] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:04,461 INFO [Listener at localhost/46349] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35621 2023-02-08 13:03:04,462 INFO [Listener at localhost/46349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:04,463 INFO [Listener at localhost/46349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:04,464 INFO [Listener at localhost/46349] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35621 connecting to ZooKeeper ensemble=127.0.0.1:64909 2023-02-08 13:03:04,473 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:356210x0, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:04,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35621-0x100340746ad0000 connected 2023-02-08 13:03:04,498 DEBUG [Listener at localhost/46349] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:04,499 DEBUG [Listener at localhost/46349] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:04,499 DEBUG [Listener at localhost/46349] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:04,507 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35621 2023-02-08 13:03:04,507 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35621 2023-02-08 13:03:04,508 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35621 2023-02-08 13:03:04,508 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35621 2023-02-08 13:03:04,508 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35621 2023-02-08 13:03:04,508 INFO [Listener at localhost/46349] master.HMaster(439): hbase.rootdir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1, hbase.cluster.distributed=false 2023-02-08 13:03:04,523 INFO [Listener at localhost/46349] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:04,523 INFO [Listener at localhost/46349] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:04,523 INFO [Listener at localhost/46349] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:04,523 INFO [Listener at localhost/46349] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:04,523 INFO [Listener at localhost/46349] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:04,523 INFO [Listener at localhost/46349] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:04,523 INFO [Listener at localhost/46349] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:04,526 INFO [Listener at localhost/46349] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39709 2023-02-08 13:03:04,526 INFO [Listener at localhost/46349] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:03:04,527 DEBUG [Listener at localhost/46349] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:04,528 INFO [Listener at localhost/46349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:04,529 INFO [Listener at localhost/46349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:04,530 INFO [Listener at localhost/46349] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39709 connecting to ZooKeeper ensemble=127.0.0.1:64909 2023-02-08 13:03:04,533 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:397090x0, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:04,534 DEBUG [Listener at localhost/46349] zookeeper.ZKUtil(164): regionserver:397090x0, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:04,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39709-0x100340746ad0001 connected 2023-02-08 13:03:04,535 DEBUG [Listener at localhost/46349] zookeeper.ZKUtil(164): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:04,535 DEBUG [Listener at localhost/46349] zookeeper.ZKUtil(164): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:04,544 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39709 2023-02-08 13:03:04,544 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39709 2023-02-08 13:03:04,544 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39709 2023-02-08 13:03:04,546 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39709 2023-02-08 13:03:04,548 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39709 2023-02-08 13:03:04,560 INFO [Listener at localhost/46349] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:04,560 INFO [Listener at localhost/46349] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:04,560 INFO [Listener at localhost/46349] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:04,560 INFO [Listener at localhost/46349] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:04,560 INFO [Listener at localhost/46349] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:04,561 INFO [Listener at localhost/46349] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:04,561 INFO [Listener at localhost/46349] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:04,562 INFO [Listener at localhost/46349] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40021 2023-02-08 13:03:04,563 INFO [Listener at localhost/46349] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:03:04,564 DEBUG [Listener at localhost/46349] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:04,564 INFO [Listener at localhost/46349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:04,565 INFO [Listener at localhost/46349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:04,566 INFO [Listener at localhost/46349] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40021 connecting to ZooKeeper ensemble=127.0.0.1:64909 2023-02-08 13:03:04,569 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:400210x0, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:04,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40021-0x100340746ad0002 connected 2023-02-08 13:03:04,570 DEBUG [Listener at localhost/46349] zookeeper.ZKUtil(164): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:04,571 DEBUG [Listener at localhost/46349] zookeeper.ZKUtil(164): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:04,571 DEBUG [Listener at localhost/46349] zookeeper.ZKUtil(164): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:04,573 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40021 2023-02-08 13:03:04,573 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40021 2023-02-08 13:03:04,573 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40021 2023-02-08 13:03:04,577 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40021 2023-02-08 13:03:04,577 DEBUG [Listener at localhost/46349] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40021 2023-02-08 13:03:04,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35621,1675861384459 2023-02-08 13:03:04,583 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:03:04,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35621,1675861384459 2023-02-08 13:03:04,584 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:04,584 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:04,585 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:04,585 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:04,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:03:04,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:03:04,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35621,1675861384459 from backup master directory 2023-02-08 13:03:04,589 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35621,1675861384459 2023-02-08 13:03:04,589 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:03:04,589 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:04,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,35621,1675861384459 2023-02-08 13:03:04,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/hbase.id with ID: db54066d-11d7-4773-abe4-4229cfd129ba 2023-02-08 13:03:04,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:04,629 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:04,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x53d89502 to 127.0.0.1:64909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:04,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53a4598a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:04,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:04,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 13:03:04,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:04,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/MasterData/data/master/store-tmp 2023-02-08 13:03:04,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:04,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:03:04,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:04,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:04,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:03:04,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:04,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:04,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861384663Disabling compacts and flushes for region at 1675861384663Disabling writes for close at 1675861384663Writing region close event to WAL at 1675861384663Closed at 1675861384663 2023-02-08 13:03:04,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/MasterData/WALs/jenkins-hbase4.apache.org,35621,1675861384459 2023-02-08 13:03:04,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35621%2C1675861384459, suffix=, logDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/MasterData/WALs/jenkins-hbase4.apache.org,35621,1675861384459, archiveDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/MasterData/oldWALs, maxLogs=10 2023-02-08 13:03:04,684 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38373,DS-b343eddc-1faa-4120-b340-f576a4113863,DISK] 2023-02-08 13:03:04,685 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43657,DS-33b62d5c-3934-47ec-aea7-e27a7fc5ded6,DISK] 2023-02-08 13:03:04,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/MasterData/WALs/jenkins-hbase4.apache.org,35621,1675861384459/jenkins-hbase4.apache.org%2C35621%2C1675861384459.1675861384667 2023-02-08 13:03:04,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38373,DS-b343eddc-1faa-4120-b340-f576a4113863,DISK], DatanodeInfoWithStorage[127.0.0.1:43657,DS-33b62d5c-3934-47ec-aea7-e27a7fc5ded6,DISK]] 2023-02-08 13:03:04,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:04,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:04,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:04,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:04,691 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:04,692 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 13:03:04,693 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 13:03:04,693 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:04,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:04,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:04,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:04,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:04,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67802745, jitterRate=0.010339632630348206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:03:04,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675861384689Initializing all the Stores at 1675861384690 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861384690Cleaning up temporary data from old regions at 1675861384695 (+5 ms)Cleaning up detritus from prior splits at 1675861384695Region opened successfully at 1675861384699 (+4 ms) 2023-02-08 13:03:04,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 13:03:04,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 13:03:04,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 13:03:04,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 13:03:04,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-08 13:03:04,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-08 13:03:04,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 13:03:04,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 13:03:04,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 13:03:04,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 13:03:04,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 13:03:04,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 13:03:04,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 13:03:04,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 13:03:04,720 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:04,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 13:03:04,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 13:03:04,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 13:03:04,722 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:04,722 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:04,722 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:04,722 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:04,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,35621,1675861384459, sessionid=0x100340746ad0000, setting cluster-up flag (Was=false) 2023-02-08 13:03:04,729 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:04,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 13:03:04,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35621,1675861384459 2023-02-08 13:03:04,737 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:04,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 13:03:04,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35621,1675861384459 2023-02-08 13:03:04,743 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.hbase-snapshot/.tmp 2023-02-08 13:03:04,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:04,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:04,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:04,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:04,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:04,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 13:03:04,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:04,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675861414749 2023-02-08 13:03:04,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 13:03:04,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 13:03:04,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 13:03:04,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 13:03:04,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 13:03:04,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 13:03:04,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,750 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:04,750 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 13:03:04,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 13:03:04,752 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:04,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 13:03:04,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 13:03:04,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 13:03:04,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 13:03:04,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861384754,5,FailOnTimeoutGroup] 2023-02-08 13:03:04,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861384756,5,FailOnTimeoutGroup] 2023-02-08 13:03:04,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 13:03:04,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,765 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:04,766 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:04,766 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1 2023-02-08 13:03:04,778 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:04,780 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:03:04,782 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(952): ClusterId : db54066d-11d7-4773-abe4-4229cfd129ba 2023-02-08 13:03:04,782 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/info 2023-02-08 13:03:04,782 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(952): ClusterId : db54066d-11d7-4773-abe4-4229cfd129ba 2023-02-08 13:03:04,782 DEBUG [RS:1;jenkins-hbase4:40021] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:03:04,782 DEBUG [RS:0;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:03:04,783 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:03:04,783 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:04,784 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:03:04,784 DEBUG [RS:1;jenkins-hbase4:40021] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:03:04,785 DEBUG [RS:1;jenkins-hbase4:40021] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:03:04,785 DEBUG [RS:0;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:03:04,785 DEBUG [RS:0;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:03:04,786 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:04,786 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:03:04,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:04,787 DEBUG [RS:1;jenkins-hbase4:40021] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:03:04,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:03:04,788 DEBUG [RS:1;jenkins-hbase4:40021] zookeeper.ReadOnlyZKClient(139): Connect 0x54d4acd6 to 127.0.0.1:64909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:04,788 DEBUG [RS:0;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:03:04,789 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/table 2023-02-08 13:03:04,790 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:03:04,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:04,796 DEBUG [RS:0;jenkins-hbase4:39709] zookeeper.ReadOnlyZKClient(139): Connect 0x4ad698d7 to 127.0.0.1:64909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:04,801 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740 2023-02-08 13:03:04,802 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740 2023-02-08 13:03:04,804 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:03:04,806 DEBUG [RS:1;jenkins-hbase4:40021] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a13483c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:04,806 DEBUG [RS:1;jenkins-hbase4:40021] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e2cc7a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:04,806 DEBUG [RS:0;jenkins-hbase4:39709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44116ffd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:04,806 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:03:04,806 DEBUG [RS:0;jenkins-hbase4:39709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@402ef3a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:04,808 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:04,809 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58937920, jitterRate=-0.12175655364990234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:03:04,809 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675861384779Initializing all the Stores at 1675861384779Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861384779Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861384779Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861384779Cleaning up temporary data from old regions at 1675861384803 (+24 ms)Cleaning up detritus from prior splits at 1675861384804 (+1 ms)Region opened successfully at 1675861384809 (+5 ms) 2023-02-08 13:03:04,809 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:03:04,809 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:03:04,809 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:03:04,809 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:03:04,809 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:03:04,812 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:04,812 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861384809Disabling compacts and flushes for region at 1675861384809Disabling writes for close at 1675861384809Writing region close event to WAL at 1675861384812 (+3 ms)Closed at 1675861384812 2023-02-08 13:03:04,813 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:04,813 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 13:03:04,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 13:03:04,816 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 13:03:04,817 DEBUG [RS:1;jenkins-hbase4:40021] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40021 2023-02-08 13:03:04,817 INFO [RS:1;jenkins-hbase4:40021] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:03:04,817 INFO [RS:1;jenkins-hbase4:40021] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:03:04,817 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 13:03:04,817 DEBUG [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:03:04,818 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35621,1675861384459 with isa=jenkins-hbase4.apache.org/172.31.14.131:40021, startcode=1675861384560 2023-02-08 13:03:04,818 DEBUG [RS:1;jenkins-hbase4:40021] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:03:04,819 DEBUG [RS:0;jenkins-hbase4:39709] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39709 2023-02-08 13:03:04,819 INFO [RS:0;jenkins-hbase4:39709] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:03:04,819 INFO [RS:0;jenkins-hbase4:39709] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:03:04,819 DEBUG [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:03:04,820 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35621,1675861384459 with isa=jenkins-hbase4.apache.org/172.31.14.131:39709, startcode=1675861384522 2023-02-08 13:03:04,820 DEBUG [RS:0;jenkins-hbase4:39709] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:03:04,824 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55271, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:03:04,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:04,828 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35959, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:03:04,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:04,829 DEBUG [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1 2023-02-08 13:03:04,829 DEBUG [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34987 2023-02-08 13:03:04,829 DEBUG [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:03:04,831 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:04,832 DEBUG [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1 2023-02-08 13:03:04,832 DEBUG [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34987 2023-02-08 13:03:04,832 DEBUG [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:03:04,832 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39709,1675861384522] 2023-02-08 13:03:04,834 DEBUG [RS:0;jenkins-hbase4:39709] zookeeper.ZKUtil(162): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:04,834 WARN [RS:0;jenkins-hbase4:39709] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:04,834 INFO [RS:0;jenkins-hbase4:39709] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:04,834 DEBUG [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/WALs/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:04,838 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:04,839 DEBUG [RS:1;jenkins-hbase4:40021] zookeeper.ZKUtil(162): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:04,839 WARN [RS:1;jenkins-hbase4:40021] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:04,839 INFO [RS:1;jenkins-hbase4:40021] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:04,839 DEBUG [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/WALs/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:04,839 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40021,1675861384560] 2023-02-08 13:03:04,840 DEBUG [RS:0;jenkins-hbase4:39709] zookeeper.ZKUtil(162): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:04,840 DEBUG [RS:0;jenkins-hbase4:39709] zookeeper.ZKUtil(162): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:04,841 DEBUG [RS:0;jenkins-hbase4:39709] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:03:04,841 INFO [RS:0;jenkins-hbase4:39709] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:03:04,851 INFO [RS:0;jenkins-hbase4:39709] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:03:04,851 INFO [RS:0;jenkins-hbase4:39709] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:03:04,851 INFO [RS:0;jenkins-hbase4:39709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,852 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:03:04,854 INFO [RS:0;jenkins-hbase4:39709] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,854 DEBUG [RS:0;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,854 DEBUG [RS:0;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,854 DEBUG [RS:0;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,854 DEBUG [RS:0;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,854 DEBUG [RS:0;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,854 DEBUG [RS:0;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:04,854 DEBUG [RS:0;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,854 DEBUG [RS:0;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,854 DEBUG [RS:0;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,854 DEBUG [RS:0;jenkins-hbase4:39709] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,855 DEBUG [RS:1;jenkins-hbase4:40021] zookeeper.ZKUtil(162): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:04,855 DEBUG [RS:1;jenkins-hbase4:40021] zookeeper.ZKUtil(162): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:04,857 DEBUG [RS:1;jenkins-hbase4:40021] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:03:04,857 INFO [RS:1;jenkins-hbase4:40021] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:03:04,863 INFO [RS:0;jenkins-hbase4:39709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,863 INFO [RS:0;jenkins-hbase4:39709] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,863 INFO [RS:1;jenkins-hbase4:40021] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:03:04,864 INFO [RS:0;jenkins-hbase4:39709] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,864 INFO [RS:1;jenkins-hbase4:40021] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:03:04,864 INFO [RS:1;jenkins-hbase4:40021] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,868 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:03:04,870 INFO [RS:1;jenkins-hbase4:40021] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,870 DEBUG [RS:1;jenkins-hbase4:40021] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,870 DEBUG [RS:1;jenkins-hbase4:40021] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,870 DEBUG [RS:1;jenkins-hbase4:40021] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,870 DEBUG [RS:1;jenkins-hbase4:40021] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,870 DEBUG [RS:1;jenkins-hbase4:40021] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,870 DEBUG [RS:1;jenkins-hbase4:40021] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:04,870 DEBUG [RS:1;jenkins-hbase4:40021] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,870 DEBUG [RS:1;jenkins-hbase4:40021] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,870 DEBUG [RS:1;jenkins-hbase4:40021] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,870 DEBUG [RS:1;jenkins-hbase4:40021] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:04,876 INFO [RS:1;jenkins-hbase4:40021] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,876 INFO [RS:1;jenkins-hbase4:40021] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,876 INFO [RS:1;jenkins-hbase4:40021] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,884 INFO [RS:0;jenkins-hbase4:39709] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:03:04,884 INFO [RS:0;jenkins-hbase4:39709] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39709,1675861384522-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,892 INFO [RS:1;jenkins-hbase4:40021] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:03:04,892 INFO [RS:1;jenkins-hbase4:40021] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40021,1675861384560-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:04,904 INFO [RS:0;jenkins-hbase4:39709] regionserver.Replication(203): jenkins-hbase4.apache.org,39709,1675861384522 started 2023-02-08 13:03:04,904 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39709,1675861384522, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39709, sessionid=0x100340746ad0001 2023-02-08 13:03:04,904 DEBUG [RS:0;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:03:04,904 DEBUG [RS:0;jenkins-hbase4:39709] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:04,904 DEBUG [RS:0;jenkins-hbase4:39709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39709,1675861384522' 2023-02-08 13:03:04,904 DEBUG [RS:0;jenkins-hbase4:39709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:04,905 DEBUG [RS:0;jenkins-hbase4:39709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:04,905 DEBUG [RS:0;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:03:04,905 DEBUG [RS:0;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:03:04,905 DEBUG [RS:0;jenkins-hbase4:39709] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:04,905 DEBUG [RS:0;jenkins-hbase4:39709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39709,1675861384522' 2023-02-08 13:03:04,905 DEBUG [RS:0;jenkins-hbase4:39709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:04,906 DEBUG [RS:0;jenkins-hbase4:39709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:04,906 DEBUG [RS:0;jenkins-hbase4:39709] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:03:04,906 INFO [RS:0;jenkins-hbase4:39709] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:03:04,906 INFO [RS:0;jenkins-hbase4:39709] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:03:04,909 INFO [RS:1;jenkins-hbase4:40021] regionserver.Replication(203): jenkins-hbase4.apache.org,40021,1675861384560 started 2023-02-08 13:03:04,909 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40021,1675861384560, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40021, sessionid=0x100340746ad0002 2023-02-08 13:03:04,909 DEBUG [RS:1;jenkins-hbase4:40021] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:03:04,909 DEBUG [RS:1;jenkins-hbase4:40021] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:04,909 DEBUG [RS:1;jenkins-hbase4:40021] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40021,1675861384560' 2023-02-08 13:03:04,909 DEBUG [RS:1;jenkins-hbase4:40021] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:04,910 DEBUG [RS:1;jenkins-hbase4:40021] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:04,910 DEBUG [RS:1;jenkins-hbase4:40021] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:03:04,910 DEBUG [RS:1;jenkins-hbase4:40021] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:03:04,910 DEBUG [RS:1;jenkins-hbase4:40021] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:04,910 DEBUG [RS:1;jenkins-hbase4:40021] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40021,1675861384560' 2023-02-08 13:03:04,910 DEBUG [RS:1;jenkins-hbase4:40021] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:04,911 DEBUG [RS:1;jenkins-hbase4:40021] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:04,911 DEBUG [RS:1;jenkins-hbase4:40021] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:03:04,911 INFO [RS:1;jenkins-hbase4:40021] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:03:04,911 INFO [RS:1;jenkins-hbase4:40021] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:03:04,967 DEBUG [jenkins-hbase4:35621] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 13:03:04,968 DEBUG [jenkins-hbase4:35621] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:04,970 DEBUG [jenkins-hbase4:35621] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:04,970 DEBUG [jenkins-hbase4:35621] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:04,970 DEBUG [jenkins-hbase4:35621] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:04,971 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39709,1675861384522, state=OPENING 2023-02-08 13:03:04,972 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 13:03:04,974 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:04,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39709,1675861384522}] 2023-02-08 13:03:04,974 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:03:05,130 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:05,131 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 13:03:05,134 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 13:03:05,138 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 13:03:05,138 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:05,141 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39709%2C1675861384522.meta, suffix=.meta, logDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/WALs/jenkins-hbase4.apache.org,39709,1675861384522, archiveDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/oldWALs, maxLogs=32 2023-02-08 13:03:05,163 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43657,DS-33b62d5c-3934-47ec-aea7-e27a7fc5ded6,DISK] 2023-02-08 13:03:05,163 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38373,DS-b343eddc-1faa-4120-b340-f576a4113863,DISK] 2023-02-08 13:03:05,165 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/WALs/jenkins-hbase4.apache.org,39709,1675861384522/jenkins-hbase4.apache.org%2C39709%2C1675861384522.meta.1675861385142.meta 2023-02-08 13:03:05,165 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43657,DS-33b62d5c-3934-47ec-aea7-e27a7fc5ded6,DISK], DatanodeInfoWithStorage[127.0.0.1:38373,DS-b343eddc-1faa-4120-b340-f576a4113863,DISK]] 2023-02-08 13:03:05,165 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:05,166 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 13:03:05,166 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 13:03:05,167 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 13:03:05,167 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 13:03:05,167 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:05,167 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 13:03:05,167 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 13:03:05,168 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:03:05,169 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/info 2023-02-08 13:03:05,169 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/info 2023-02-08 13:03:05,170 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:03:05,171 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:05,171 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:03:05,172 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:05,172 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:05,172 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:03:05,173 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:05,173 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:03:05,174 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/table 2023-02-08 13:03:05,174 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/table 2023-02-08 13:03:05,174 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:03:05,175 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:05,176 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740 2023-02-08 13:03:05,177 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740 2023-02-08 13:03:05,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:03:05,181 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:03:05,182 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72720354, jitterRate=0.08361771702766418}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:03:05,182 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675861385167Writing region info on filesystem at 1675861385167Initializing all the Stores at 1675861385168 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861385168Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861385168Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861385168Cleaning up temporary data from old regions at 1675861385178 (+10 ms)Cleaning up detritus from prior splits at 1675861385179 (+1 ms)Running coprocessor post-open hooks at 1675861385182 (+3 ms)Region opened successfully at 1675861385182 2023-02-08 13:03:05,183 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675861385130 2023-02-08 13:03:05,187 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 13:03:05,188 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 13:03:05,188 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39709,1675861384522, state=OPEN 2023-02-08 13:03:05,190 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 13:03:05,190 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:03:05,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 13:03:05,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39709,1675861384522 in 216 msec 2023-02-08 13:03:05,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 13:03:05,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 379 msec 2023-02-08 13:03:05,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 451 msec 2023-02-08 13:03:05,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675861384583, completionTime=-1 2023-02-08 13:03:05,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 13:03:05,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 13:03:05,199 DEBUG [hconnection-0x129bc801-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:05,201 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53432, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:05,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 13:03:05,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675861445203 2023-02-08 13:03:05,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675861505203 2023-02-08 13:03:05,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-08 13:03:05,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35621,1675861384459-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:05,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35621,1675861384459-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:05,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35621,1675861384459-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:05,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35621, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:05,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:05,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 13:03:05,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:05,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 13:03:05,216 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 13:03:05,217 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:03:05,218 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:03:05,220 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/hbase/namespace/cfdb1186af27595316aea7a5b72c2155 2023-02-08 13:03:05,221 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/hbase/namespace/cfdb1186af27595316aea7a5b72c2155 empty. 2023-02-08 13:03:05,224 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/hbase/namespace/cfdb1186af27595316aea7a5b72c2155 2023-02-08 13:03:05,224 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 13:03:05,239 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:05,240 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => cfdb1186af27595316aea7a5b72c2155, NAME => 'hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp 2023-02-08 13:03:05,248 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:05,248 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing cfdb1186af27595316aea7a5b72c2155, disabling compactions & flushes 2023-02-08 13:03:05,248 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. 2023-02-08 13:03:05,248 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. 2023-02-08 13:03:05,248 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. after waiting 0 ms 2023-02-08 13:03:05,248 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. 2023-02-08 13:03:05,248 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. 2023-02-08 13:03:05,248 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for cfdb1186af27595316aea7a5b72c2155: Waiting for close lock at 1675861385248Disabling compacts and flushes for region at 1675861385248Disabling writes for close at 1675861385248Writing region close event to WAL at 1675861385248Closed at 1675861385248 2023-02-08 13:03:05,251 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:03:05,253 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861385252"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861385252"}]},"ts":"1675861385252"} 2023-02-08 13:03:05,255 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 13:03:05,256 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:03:05,257 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861385257"}]},"ts":"1675861385257"} 2023-02-08 13:03:05,258 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 13:03:05,261 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:05,262 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:05,262 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:05,262 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:05,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cfdb1186af27595316aea7a5b72c2155, ASSIGN}] 2023-02-08 13:03:05,265 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cfdb1186af27595316aea7a5b72c2155, ASSIGN 2023-02-08 13:03:05,266 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=cfdb1186af27595316aea7a5b72c2155, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40021,1675861384560; forceNewPlan=false, retain=false 2023-02-08 13:03:05,416 INFO [jenkins-hbase4:35621] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 13:03:05,417 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cfdb1186af27595316aea7a5b72c2155, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:05,417 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861385417"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861385417"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861385417"}]},"ts":"1675861385417"} 2023-02-08 13:03:05,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure cfdb1186af27595316aea7a5b72c2155, server=jenkins-hbase4.apache.org,40021,1675861384560}] 2023-02-08 13:03:05,575 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:05,575 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 13:03:05,578 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55488, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 13:03:05,582 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. 2023-02-08 13:03:05,584 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40021%2C1675861384560, suffix=, logDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/WALs/jenkins-hbase4.apache.org,40021,1675861384560, archiveDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/oldWALs, maxLogs=32 2023-02-08 13:03:05,605 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43657,DS-33b62d5c-3934-47ec-aea7-e27a7fc5ded6,DISK] 2023-02-08 13:03:05,605 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38373,DS-b343eddc-1faa-4120-b340-f576a4113863,DISK] 2023-02-08 13:03:05,607 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/WALs/jenkins-hbase4.apache.org,40021,1675861384560/jenkins-hbase4.apache.org%2C40021%2C1675861384560.1675861385585 2023-02-08 13:03:05,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43657,DS-33b62d5c-3934-47ec-aea7-e27a7fc5ded6,DISK], DatanodeInfoWithStorage[127.0.0.1:38373,DS-b343eddc-1faa-4120-b340-f576a4113863,DISK]] 2023-02-08 13:03:05,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cfdb1186af27595316aea7a5b72c2155, NAME => 'hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:05,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace cfdb1186af27595316aea7a5b72c2155 2023-02-08 13:03:05,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:05,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cfdb1186af27595316aea7a5b72c2155 2023-02-08 13:03:05,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cfdb1186af27595316aea7a5b72c2155 2023-02-08 13:03:05,609 INFO [StoreOpener-cfdb1186af27595316aea7a5b72c2155-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cfdb1186af27595316aea7a5b72c2155 2023-02-08 13:03:05,611 DEBUG [StoreOpener-cfdb1186af27595316aea7a5b72c2155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/namespace/cfdb1186af27595316aea7a5b72c2155/info 2023-02-08 13:03:05,611 DEBUG [StoreOpener-cfdb1186af27595316aea7a5b72c2155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/namespace/cfdb1186af27595316aea7a5b72c2155/info 2023-02-08 13:03:05,611 INFO [StoreOpener-cfdb1186af27595316aea7a5b72c2155-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfdb1186af27595316aea7a5b72c2155 columnFamilyName info 2023-02-08 13:03:05,612 INFO [StoreOpener-cfdb1186af27595316aea7a5b72c2155-1] regionserver.HStore(310): Store=cfdb1186af27595316aea7a5b72c2155/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:05,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/namespace/cfdb1186af27595316aea7a5b72c2155 2023-02-08 13:03:05,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/namespace/cfdb1186af27595316aea7a5b72c2155 2023-02-08 13:03:05,617 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cfdb1186af27595316aea7a5b72c2155 2023-02-08 13:03:05,619 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/namespace/cfdb1186af27595316aea7a5b72c2155/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:05,619 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cfdb1186af27595316aea7a5b72c2155; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61252978, jitterRate=-0.08725950121879578}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:03:05,619 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cfdb1186af27595316aea7a5b72c2155: Running coprocessor pre-open hook at 1675861385608Writing region info on filesystem at 1675861385608Initializing all the Stores at 1675861385609 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861385609Cleaning up temporary data from old regions at 1675861385614 (+5 ms)Cleaning up detritus from prior splits at 1675861385614Running coprocessor post-open hooks at 1675861385619 (+5 ms)Region opened successfully at 1675861385619 2023-02-08 13:03:05,620 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155., pid=6, masterSystemTime=1675861385575 2023-02-08 13:03:05,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. 2023-02-08 13:03:05,625 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cfdb1186af27595316aea7a5b72c2155, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:05,626 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. 2023-02-08 13:03:05,626 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861385625"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861385625"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861385625"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861385625"}]},"ts":"1675861385625"} 2023-02-08 13:03:05,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 13:03:05,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure cfdb1186af27595316aea7a5b72c2155, server=jenkins-hbase4.apache.org,40021,1675861384560 in 206 msec 2023-02-08 13:03:05,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 13:03:05,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=cfdb1186af27595316aea7a5b72c2155, ASSIGN in 367 msec 2023-02-08 13:03:05,633 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:03:05,633 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861385633"}]},"ts":"1675861385633"} 2023-02-08 13:03:05,635 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 13:03:05,639 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:03:05,640 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 424 msec 2023-02-08 13:03:05,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 13:03:05,719 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:05,719 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:05,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:05,725 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55496, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:05,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 13:03:05,737 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:05,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-08 13:03:05,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 13:03:05,758 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:05,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-08 13:03:05,774 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 13:03:05,776 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 13:03:05,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.188sec 2023-02-08 13:03:05,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 13:03:05,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 13:03:05,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 13:03:05,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35621,1675861384459-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 13:03:05,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35621,1675861384459-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 13:03:05,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 13:03:05,782 DEBUG [Listener at localhost/46349] zookeeper.ReadOnlyZKClient(139): Connect 0x47637cda to 127.0.0.1:64909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:05,788 DEBUG [Listener at localhost/46349] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79128360, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:05,790 DEBUG [hconnection-0xb0acbfc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:05,800 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53442, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:05,802 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35621,1675861384459 2023-02-08 13:03:05,802 DEBUG [Listener at localhost/46349] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 13:03:05,802 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:05,802 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:05,804 DEBUG [Listener at localhost/46349] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 13:03:05,808 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59512, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 13:03:05,809 INFO [Listener at localhost/46349] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-08 13:03:05,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-08 13:03:05,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 13:03:05,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:59512 deadline: 1675861445809, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-08 13:03:05,810 INFO [Listener at localhost/46349] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-08 13:03:05,811 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:05,811 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:05,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:05,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-08 13:03:05,817 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:03:05,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-08 13:03:05,817 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:05,817 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:05,817 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:03:05,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:05,826 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:05,826 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:05,826 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:05,826 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:05,827 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:05,826 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:05,826 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:05,827 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:05,827 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/4fab3b755525525a1b3d8c1e9b5f1662 empty. 2023-02-08 13:03:05,827 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b empty. 2023-02-08 13:03:05,827 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb empty. 2023-02-08 13:03:05,828 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3 empty. 2023-02-08 13:03:05,828 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4 empty. 2023-02-08 13:03:05,828 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a empty. 2023-02-08 13:03:05,828 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d empty. 2023-02-08 13:03:05,829 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:05,829 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:05,829 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:05,829 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:05,829 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:05,829 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:05,829 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:05,829 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:05,829 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87 empty. 2023-02-08 13:03:05,830 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/4e985e29dd592f319583db6f3f6cf869 empty. 2023-02-08 13:03:05,830 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:05,830 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:05,830 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90 empty. 2023-02-08 13:03:05,830 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:05,830 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:05,830 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-08 13:03:05,841 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:05,843 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 86ea3299ee0b3655463ad474dbd2e36b, NAME => 'testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp 2023-02-08 13:03:05,843 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3c61a4344edb4e7db2fd002a7a51fdbb, NAME => 'testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp 2023-02-08 13:03:05,843 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4fab3b755525525a1b3d8c1e9b5f1662, NAME => 'testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp 2023-02-08 13:03:05,856 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:05,856 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 86ea3299ee0b3655463ad474dbd2e36b, disabling compactions & flushes 2023-02-08 13:03:05,856 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:05,856 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:05,856 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. after waiting 0 ms 2023-02-08 13:03:05,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:05,857 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:05,857 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 86ea3299ee0b3655463ad474dbd2e36b: Waiting for close lock at 1675861385856Disabling compacts and flushes for region at 1675861385856Disabling writes for close at 1675861385857 (+1 ms)Writing region close event to WAL at 1675861385857Closed at 1675861385857 2023-02-08 13:03:05,857 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 339eb211e42ee5c15cac8e475de59e5d, NAME => 'testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp 2023-02-08 13:03:05,859 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:05,859 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 3c61a4344edb4e7db2fd002a7a51fdbb, disabling compactions & flushes 2023-02-08 13:03:05,859 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:05,859 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:05,859 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. after waiting 0 ms 2023-02-08 13:03:05,859 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:05,859 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:05,859 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 3c61a4344edb4e7db2fd002a7a51fdbb: Waiting for close lock at 1675861385859Disabling compacts and flushes for region at 1675861385859Disabling writes for close at 1675861385859Writing region close event to WAL at 1675861385859Closed at 1675861385859 2023-02-08 13:03:05,860 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0f324c53feb5004dc32970d166e42a4a, NAME => 'testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp 2023-02-08 13:03:05,860 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:05,860 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 4fab3b755525525a1b3d8c1e9b5f1662, disabling compactions & flushes 2023-02-08 13:03:05,860 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:05,860 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:05,860 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. after waiting 0 ms 2023-02-08 13:03:05,860 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:05,860 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:05,860 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 4fab3b755525525a1b3d8c1e9b5f1662: Waiting for close lock at 1675861385860Disabling compacts and flushes for region at 1675861385860Disabling writes for close at 1675861385860Writing region close event to WAL at 1675861385860Closed at 1675861385860 2023-02-08 13:03:05,861 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => a130a58e526c1ec31f1634967d9c6aa4, NAME => 'testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp 2023-02-08 13:03:05,876 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:05,876 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 339eb211e42ee5c15cac8e475de59e5d, disabling compactions & flushes 2023-02-08 13:03:05,876 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:05,876 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:05,876 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. after waiting 0 ms 2023-02-08 13:03:05,876 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:05,876 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:05,876 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 339eb211e42ee5c15cac8e475de59e5d: Waiting for close lock at 1675861385876Disabling compacts and flushes for region at 1675861385876Disabling writes for close at 1675861385876Writing region close event to WAL at 1675861385876Closed at 1675861385876 2023-02-08 13:03:05,877 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 29c979748dd245a848d7f00e7e64d7a3, NAME => 'testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp 2023-02-08 13:03:05,879 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:05,879 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing a130a58e526c1ec31f1634967d9c6aa4, disabling compactions & flushes 2023-02-08 13:03:05,879 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:05,879 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:05,879 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. after waiting 0 ms 2023-02-08 13:03:05,879 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:05,879 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:05,880 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for a130a58e526c1ec31f1634967d9c6aa4: Waiting for close lock at 1675861385879Disabling compacts and flushes for region at 1675861385879Disabling writes for close at 1675861385879Writing region close event to WAL at 1675861385879Closed at 1675861385879 2023-02-08 13:03:05,880 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => fff00124cd01a9a3f626404ca9571f87, NAME => 'testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp 2023-02-08 13:03:05,891 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:05,891 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:05,891 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing fff00124cd01a9a3f626404ca9571f87, disabling compactions & flushes 2023-02-08 13:03:05,891 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 29c979748dd245a848d7f00e7e64d7a3, disabling compactions & flushes 2023-02-08 13:03:05,891 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:05,891 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:05,891 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:05,891 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:05,891 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. after waiting 0 ms 2023-02-08 13:03:05,891 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. after waiting 0 ms 2023-02-08 13:03:05,892 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:05,892 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:05,892 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:05,892 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:05,892 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for fff00124cd01a9a3f626404ca9571f87: Waiting for close lock at 1675861385891Disabling compacts and flushes for region at 1675861385891Disabling writes for close at 1675861385892 (+1 ms)Writing region close event to WAL at 1675861385892Closed at 1675861385892 2023-02-08 13:03:05,892 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 29c979748dd245a848d7f00e7e64d7a3: Waiting for close lock at 1675861385891Disabling compacts and flushes for region at 1675861385891Disabling writes for close at 1675861385892 (+1 ms)Writing region close event to WAL at 1675861385892Closed at 1675861385892 2023-02-08 13:03:05,892 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6b402cc95a33009ae614fee264ac5d90, NAME => 'testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp 2023-02-08 13:03:05,893 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4e985e29dd592f319583db6f3f6cf869, NAME => 'testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.tmp 2023-02-08 13:03:05,899 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:05,899 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 6b402cc95a33009ae614fee264ac5d90, disabling compactions & flushes 2023-02-08 13:03:05,899 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:05,899 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:05,899 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. after waiting 0 ms 2023-02-08 13:03:05,899 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:05,899 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:05,899 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 6b402cc95a33009ae614fee264ac5d90: Waiting for close lock at 1675861385899Disabling compacts and flushes for region at 1675861385899Disabling writes for close at 1675861385899Writing region close event to WAL at 1675861385899Closed at 1675861385899 2023-02-08 13:03:05,901 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:05,901 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4e985e29dd592f319583db6f3f6cf869, disabling compactions & flushes 2023-02-08 13:03:05,901 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:05,901 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:05,901 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. after waiting 0 ms 2023-02-08 13:03:05,901 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:05,901 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:05,901 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4e985e29dd592f319583db6f3f6cf869: Waiting for close lock at 1675861385901Disabling compacts and flushes for region at 1675861385901Disabling writes for close at 1675861385901Writing region close event to WAL at 1675861385901Closed at 1675861385901 2023-02-08 13:03:05,908 INFO [RS:0;jenkins-hbase4:39709] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39709%2C1675861384522, suffix=, logDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/WALs/jenkins-hbase4.apache.org,39709,1675861384522, archiveDir=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/oldWALs, maxLogs=32 2023-02-08 13:03:05,919 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:05,919 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:05,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:05,924 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38373,DS-b343eddc-1faa-4120-b340-f576a4113863,DISK] 2023-02-08 13:03:05,925 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43657,DS-33b62d5c-3934-47ec-aea7-e27a7fc5ded6,DISK] 2023-02-08 13:03:05,927 INFO [RS:0;jenkins-hbase4:39709] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/WALs/jenkins-hbase4.apache.org,39709,1675861384522/jenkins-hbase4.apache.org%2C39709%2C1675861384522.1675861385908 2023-02-08 13:03:05,927 DEBUG [RS:0;jenkins-hbase4:39709] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38373,DS-b343eddc-1faa-4120-b340-f576a4113863,DISK], DatanodeInfoWithStorage[127.0.0.1:43657,DS-33b62d5c-3934-47ec-aea7-e27a7fc5ded6,DISK]] 2023-02-08 13:03:06,132 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:06,132 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:06,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:06,274 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:06,274 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 0f324c53feb5004dc32970d166e42a4a, disabling compactions & flushes 2023-02-08 13:03:06,274 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:06,274 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:06,274 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. after waiting 0 ms 2023-02-08 13:03:06,274 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:06,274 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:06,274 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 0f324c53feb5004dc32970d166e42a4a: Waiting for close lock at 1675861386274Disabling compacts and flushes for region at 1675861386274Disabling writes for close at 1675861386274Writing region close event to WAL at 1675861386274Closed at 1675861386274 2023-02-08 13:03:06,277 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:03:06,278 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861386278"}]},"ts":"1675861386278"} 2023-02-08 13:03:06,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861386278"}]},"ts":"1675861386278"} 2023-02-08 13:03:06,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861386278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861386278"}]},"ts":"1675861386278"} 2023-02-08 13:03:06,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861386278"}]},"ts":"1675861386278"} 2023-02-08 13:03:06,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861386278"}]},"ts":"1675861386278"} 2023-02-08 13:03:06,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861386278"}]},"ts":"1675861386278"} 2023-02-08 13:03:06,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861386278"}]},"ts":"1675861386278"} 2023-02-08 13:03:06,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861386278"}]},"ts":"1675861386278"} 2023-02-08 13:03:06,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861386278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861386278"}]},"ts":"1675861386278"} 2023-02-08 13:03:06,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861386278"}]},"ts":"1675861386278"} 2023-02-08 13:03:06,286 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-08 13:03:06,287 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:03:06,288 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861386288"}]},"ts":"1675861386288"} 2023-02-08 13:03:06,290 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-08 13:03:06,294 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:06,303 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:06,303 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:06,303 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:06,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4fab3b755525525a1b3d8c1e9b5f1662, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3c61a4344edb4e7db2fd002a7a51fdbb, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=86ea3299ee0b3655463ad474dbd2e36b, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=339eb211e42ee5c15cac8e475de59e5d, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0f324c53feb5004dc32970d166e42a4a, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a130a58e526c1ec31f1634967d9c6aa4, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=29c979748dd245a848d7f00e7e64d7a3, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fff00124cd01a9a3f626404ca9571f87, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6b402cc95a33009ae614fee264ac5d90, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4e985e29dd592f319583db6f3f6cf869, ASSIGN}] 2023-02-08 13:03:06,306 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=339eb211e42ee5c15cac8e475de59e5d, ASSIGN 2023-02-08 13:03:06,306 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4fab3b755525525a1b3d8c1e9b5f1662, ASSIGN 2023-02-08 13:03:06,306 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=86ea3299ee0b3655463ad474dbd2e36b, ASSIGN 2023-02-08 13:03:06,306 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3c61a4344edb4e7db2fd002a7a51fdbb, ASSIGN 2023-02-08 13:03:06,307 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=339eb211e42ee5c15cac8e475de59e5d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40021,1675861384560; forceNewPlan=false, retain=false 2023-02-08 13:03:06,307 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=86ea3299ee0b3655463ad474dbd2e36b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39709,1675861384522; forceNewPlan=false, retain=false 2023-02-08 13:03:06,307 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4fab3b755525525a1b3d8c1e9b5f1662, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39709,1675861384522; forceNewPlan=false, retain=false 2023-02-08 13:03:06,307 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3c61a4344edb4e7db2fd002a7a51fdbb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40021,1675861384560; forceNewPlan=false, retain=false 2023-02-08 13:03:06,308 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4e985e29dd592f319583db6f3f6cf869, ASSIGN 2023-02-08 13:03:06,308 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6b402cc95a33009ae614fee264ac5d90, ASSIGN 2023-02-08 13:03:06,308 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fff00124cd01a9a3f626404ca9571f87, ASSIGN 2023-02-08 13:03:06,309 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=29c979748dd245a848d7f00e7e64d7a3, ASSIGN 2023-02-08 13:03:06,309 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a130a58e526c1ec31f1634967d9c6aa4, ASSIGN 2023-02-08 13:03:06,309 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4e985e29dd592f319583db6f3f6cf869, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39709,1675861384522; forceNewPlan=false, retain=false 2023-02-08 13:03:06,309 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6b402cc95a33009ae614fee264ac5d90, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40021,1675861384560; forceNewPlan=false, retain=false 2023-02-08 13:03:06,310 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fff00124cd01a9a3f626404ca9571f87, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40021,1675861384560; forceNewPlan=false, retain=false 2023-02-08 13:03:06,310 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=29c979748dd245a848d7f00e7e64d7a3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39709,1675861384522; forceNewPlan=false, retain=false 2023-02-08 13:03:06,312 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a130a58e526c1ec31f1634967d9c6aa4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39709,1675861384522; forceNewPlan=false, retain=false 2023-02-08 13:03:06,312 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0f324c53feb5004dc32970d166e42a4a, ASSIGN 2023-02-08 13:03:06,312 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0f324c53feb5004dc32970d166e42a4a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40021,1675861384560; forceNewPlan=false, retain=false 2023-02-08 13:03:06,434 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:06,434 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:06,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:06,458 INFO [jenkins-hbase4:35621] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-08 13:03:06,461 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=339eb211e42ee5c15cac8e475de59e5d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:06,461 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=6b402cc95a33009ae614fee264ac5d90, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:06,461 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=fff00124cd01a9a3f626404ca9571f87, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:06,461 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0f324c53feb5004dc32970d166e42a4a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:06,462 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386461"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861386461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861386461"}]},"ts":"1675861386461"} 2023-02-08 13:03:06,462 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=3c61a4344edb4e7db2fd002a7a51fdbb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:06,462 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386462"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861386462"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861386462"}]},"ts":"1675861386462"} 2023-02-08 13:03:06,462 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386461"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861386461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861386461"}]},"ts":"1675861386461"} 2023-02-08 13:03:06,462 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386461"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861386461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861386461"}]},"ts":"1675861386461"} 2023-02-08 13:03:06,462 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386461"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861386461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861386461"}]},"ts":"1675861386461"} 2023-02-08 13:03:06,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure 339eb211e42ee5c15cac8e475de59e5d, server=jenkins-hbase4.apache.org,40021,1675861384560}] 2023-02-08 13:03:06,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure 3c61a4344edb4e7db2fd002a7a51fdbb, server=jenkins-hbase4.apache.org,40021,1675861384560}] 2023-02-08 13:03:06,467 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure 0f324c53feb5004dc32970d166e42a4a, server=jenkins-hbase4.apache.org,40021,1675861384560}] 2023-02-08 13:03:06,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=19, state=RUNNABLE; OpenRegionProcedure 6b402cc95a33009ae614fee264ac5d90, server=jenkins-hbase4.apache.org,40021,1675861384560}] 2023-02-08 13:03:06,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=18, state=RUNNABLE; OpenRegionProcedure fff00124cd01a9a3f626404ca9571f87, server=jenkins-hbase4.apache.org,40021,1675861384560}] 2023-02-08 13:03:06,470 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4e985e29dd592f319583db6f3f6cf869, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:06,470 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861386470"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861386470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861386470"}]},"ts":"1675861386470"} 2023-02-08 13:03:06,471 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=86ea3299ee0b3655463ad474dbd2e36b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:06,471 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386471"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861386471"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861386471"}]},"ts":"1675861386471"} 2023-02-08 13:03:06,478 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure 4e985e29dd592f319583db6f3f6cf869, server=jenkins-hbase4.apache.org,39709,1675861384522}] 2023-02-08 13:03:06,479 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=29c979748dd245a848d7f00e7e64d7a3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:06,479 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a130a58e526c1ec31f1634967d9c6aa4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:06,479 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386479"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861386479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861386479"}]},"ts":"1675861386479"} 2023-02-08 13:03:06,479 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386479"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861386479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861386479"}]},"ts":"1675861386479"} 2023-02-08 13:03:06,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=13, state=RUNNABLE; OpenRegionProcedure 86ea3299ee0b3655463ad474dbd2e36b, server=jenkins-hbase4.apache.org,39709,1675861384522}] 2023-02-08 13:03:06,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure 29c979748dd245a848d7f00e7e64d7a3, server=jenkins-hbase4.apache.org,39709,1675861384522}] 2023-02-08 13:03:06,482 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure a130a58e526c1ec31f1634967d9c6aa4, server=jenkins-hbase4.apache.org,39709,1675861384522}] 2023-02-08 13:03:06,484 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4fab3b755525525a1b3d8c1e9b5f1662, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:06,484 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861386484"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861386484"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861386484"}]},"ts":"1675861386484"} 2023-02-08 13:03:06,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure 4fab3b755525525a1b3d8c1e9b5f1662, server=jenkins-hbase4.apache.org,39709,1675861384522}] 2023-02-08 13:03:06,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:06,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3c61a4344edb4e7db2fd002a7a51fdbb, NAME => 'testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-08 13:03:06,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:06,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:06,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:06,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:06,628 INFO [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:06,630 DEBUG [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f1 2023-02-08 13:03:06,630 DEBUG [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f1 2023-02-08 13:03:06,630 INFO [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c61a4344edb4e7db2fd002a7a51fdbb columnFamilyName f1 2023-02-08 13:03:06,631 INFO [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] regionserver.HStore(310): Store=3c61a4344edb4e7db2fd002a7a51fdbb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,631 INFO [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:06,632 DEBUG [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f2 2023-02-08 13:03:06,633 DEBUG [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f2 2023-02-08 13:03:06,633 INFO [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c61a4344edb4e7db2fd002a7a51fdbb columnFamilyName f2 2023-02-08 13:03:06,633 INFO [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] regionserver.HStore(310): Store=3c61a4344edb4e7db2fd002a7a51fdbb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:06,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:06,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:06,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:06,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 86ea3299ee0b3655463ad474dbd2e36b, NAME => 'testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-08 13:03:06,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:06,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:06,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:06,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:06,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:06,639 INFO [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:06,640 DEBUG [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f1 2023-02-08 13:03:06,640 DEBUG [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f1 2023-02-08 13:03:06,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:06,640 INFO [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86ea3299ee0b3655463ad474dbd2e36b columnFamilyName f1 2023-02-08 13:03:06,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3c61a4344edb4e7db2fd002a7a51fdbb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61866856, jitterRate=-0.07811200618743896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:06,641 INFO [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] regionserver.HStore(310): Store=86ea3299ee0b3655463ad474dbd2e36b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3c61a4344edb4e7db2fd002a7a51fdbb: Running coprocessor pre-open hook at 1675861386624Writing region info on filesystem at 1675861386624Initializing all the Stores at 1675861386625 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386625Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386628 (+3 ms)Cleaning up temporary data from old regions at 1675861386636 (+8 ms)Cleaning up detritus from prior splits at 1675861386636Running coprocessor post-open hooks at 1675861386641 (+5 ms)Region opened successfully at 1675861386641 2023-02-08 13:03:06,641 INFO [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:06,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb., pid=22, masterSystemTime=1675861386618 2023-02-08 13:03:06,643 DEBUG [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f2 2023-02-08 13:03:06,643 DEBUG [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f2 2023-02-08 13:03:06,643 INFO [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86ea3299ee0b3655463ad474dbd2e36b columnFamilyName f2 2023-02-08 13:03:06,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:06,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:06,644 INFO [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] regionserver.HStore(310): Store=86ea3299ee0b3655463ad474dbd2e36b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:06,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0f324c53feb5004dc32970d166e42a4a, NAME => 'testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-08 13:03:06,644 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=3c61a4344edb4e7db2fd002a7a51fdbb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:06,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:06,644 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386644"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861386644"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861386644"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861386644"}]},"ts":"1675861386644"} 2023-02-08 13:03:06,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:06,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:06,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:06,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:06,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:06,647 INFO [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:06,648 DEBUG [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f1 2023-02-08 13:03:06,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:06,649 DEBUG [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f1 2023-02-08 13:03:06,649 INFO [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f324c53feb5004dc32970d166e42a4a columnFamilyName f1 2023-02-08 13:03:06,649 INFO [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] regionserver.HStore(310): Store=0f324c53feb5004dc32970d166e42a4a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-08 13:03:06,650 INFO [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:06,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure 3c61a4344edb4e7db2fd002a7a51fdbb, server=jenkins-hbase4.apache.org,40021,1675861384560 in 181 msec 2023-02-08 13:03:06,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:06,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3c61a4344edb4e7db2fd002a7a51fdbb, ASSIGN in 346 msec 2023-02-08 13:03:06,651 DEBUG [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f2 2023-02-08 13:03:06,651 DEBUG [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f2 2023-02-08 13:03:06,651 INFO [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f324c53feb5004dc32970d166e42a4a columnFamilyName f2 2023-02-08 13:03:06,652 INFO [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] regionserver.HStore(310): Store=0f324c53feb5004dc32970d166e42a4a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:06,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:06,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:06,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 86ea3299ee0b3655463ad474dbd2e36b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73368695, jitterRate=0.09327875077724457}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:06,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 86ea3299ee0b3655463ad474dbd2e36b: Running coprocessor pre-open hook at 1675861386638Writing region info on filesystem at 1675861386638Initializing all the Stores at 1675861386638Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386638Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386639 (+1 ms)Cleaning up temporary data from old regions at 1675861386647 (+8 ms)Cleaning up detritus from prior splits at 1675861386648 (+1 ms)Running coprocessor post-open hooks at 1675861386654 (+6 ms)Region opened successfully at 1675861386654 2023-02-08 13:03:06,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b., pid=27, masterSystemTime=1675861386634 2023-02-08 13:03:06,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:06,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:06,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:06,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:06,657 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=86ea3299ee0b3655463ad474dbd2e36b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:06,657 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386657"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861386657"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861386657"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861386657"}]},"ts":"1675861386657"} 2023-02-08 13:03:06,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 29c979748dd245a848d7f00e7e64d7a3, NAME => 'testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-08 13:03:06,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:06,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:06,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:06,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:06,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:06,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:06,661 INFO [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:06,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=13 2023-02-08 13:03:06,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=13, state=SUCCESS; OpenRegionProcedure 86ea3299ee0b3655463ad474dbd2e36b, server=jenkins-hbase4.apache.org,39709,1675861384522 in 179 msec 2023-02-08 13:03:06,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0f324c53feb5004dc32970d166e42a4a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70179028, jitterRate=0.045749008655548096}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:06,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0f324c53feb5004dc32970d166e42a4a: Running coprocessor pre-open hook at 1675861386645Writing region info on filesystem at 1675861386645Initializing all the Stores at 1675861386646 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386646Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386646Cleaning up temporary data from old regions at 1675861386655 (+9 ms)Cleaning up detritus from prior splits at 1675861386655Running coprocessor post-open hooks at 1675861386661 (+6 ms)Region opened successfully at 1675861386661 2023-02-08 13:03:06,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a., pid=23, masterSystemTime=1675861386618 2023-02-08 13:03:06,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=86ea3299ee0b3655463ad474dbd2e36b, ASSIGN in 357 msec 2023-02-08 13:03:06,663 DEBUG [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f1 2023-02-08 13:03:06,663 DEBUG [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f1 2023-02-08 13:03:06,663 INFO [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29c979748dd245a848d7f00e7e64d7a3 columnFamilyName f1 2023-02-08 13:03:06,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:06,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:06,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:06,664 INFO [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] regionserver.HStore(310): Store=29c979748dd245a848d7f00e7e64d7a3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fff00124cd01a9a3f626404ca9571f87, NAME => 'testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-08 13:03:06,664 INFO [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:06,664 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0f324c53feb5004dc32970d166e42a4a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:06,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:06,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:06,664 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386664"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861386664"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861386664"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861386664"}]},"ts":"1675861386664"} 2023-02-08 13:03:06,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:06,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:06,666 INFO [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:06,666 DEBUG [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f2 2023-02-08 13:03:06,666 DEBUG [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f2 2023-02-08 13:03:06,666 INFO [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29c979748dd245a848d7f00e7e64d7a3 columnFamilyName f2 2023-02-08 13:03:06,667 INFO [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] regionserver.HStore(310): Store=29c979748dd245a848d7f00e7e64d7a3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,668 DEBUG [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f1 2023-02-08 13:03:06,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:06,668 DEBUG [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f1 2023-02-08 13:03:06,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:06,668 INFO [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fff00124cd01a9a3f626404ca9571f87 columnFamilyName f1 2023-02-08 13:03:06,669 INFO [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] regionserver.HStore(310): Store=fff00124cd01a9a3f626404ca9571f87/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-08 13:03:06,669 INFO [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:06,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure 0f324c53feb5004dc32970d166e42a4a, server=jenkins-hbase4.apache.org,40021,1675861384560 in 199 msec 2023-02-08 13:03:06,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0f324c53feb5004dc32970d166e42a4a, ASSIGN in 365 msec 2023-02-08 13:03:06,672 DEBUG [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f2 2023-02-08 13:03:06,672 DEBUG [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f2 2023-02-08 13:03:06,672 INFO [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fff00124cd01a9a3f626404ca9571f87 columnFamilyName f2 2023-02-08 13:03:06,673 INFO [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] regionserver.HStore(310): Store=fff00124cd01a9a3f626404ca9571f87/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:06,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:06,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:06,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 29c979748dd245a848d7f00e7e64d7a3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59028486, jitterRate=-0.12040701508522034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:06,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 29c979748dd245a848d7f00e7e64d7a3: Running coprocessor pre-open hook at 1675861386660Writing region info on filesystem at 1675861386660Initializing all the Stores at 1675861386661 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386661Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386661Cleaning up temporary data from old regions at 1675861386670 (+9 ms)Cleaning up detritus from prior splits at 1675861386672 (+2 ms)Running coprocessor post-open hooks at 1675861386677 (+5 ms)Region opened successfully at 1675861386677 2023-02-08 13:03:06,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3., pid=28, masterSystemTime=1675861386634 2023-02-08 13:03:06,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:06,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:06,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:06,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:06,680 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=29c979748dd245a848d7f00e7e64d7a3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:06,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4fab3b755525525a1b3d8c1e9b5f1662, NAME => 'testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-08 13:03:06,680 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386680"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861386680"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861386680"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861386680"}]},"ts":"1675861386680"} 2023-02-08 13:03:06,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:06,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:06,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:06,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:06,683 INFO [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:06,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-08 13:03:06,689 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure 29c979748dd245a848d7f00e7e64d7a3, server=jenkins-hbase4.apache.org,39709,1675861384522 in 201 msec 2023-02-08 13:03:06,690 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=29c979748dd245a848d7f00e7e64d7a3, ASSIGN in 385 msec 2023-02-08 13:03:06,692 DEBUG [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4fab3b755525525a1b3d8c1e9b5f1662/f1 2023-02-08 13:03:06,692 DEBUG [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4fab3b755525525a1b3d8c1e9b5f1662/f1 2023-02-08 13:03:06,692 INFO [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fab3b755525525a1b3d8c1e9b5f1662 columnFamilyName f1 2023-02-08 13:03:06,693 INFO [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] regionserver.HStore(310): Store=4fab3b755525525a1b3d8c1e9b5f1662/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,693 INFO [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:06,694 DEBUG [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4fab3b755525525a1b3d8c1e9b5f1662/f2 2023-02-08 13:03:06,694 DEBUG [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4fab3b755525525a1b3d8c1e9b5f1662/f2 2023-02-08 13:03:06,694 INFO [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fab3b755525525a1b3d8c1e9b5f1662 columnFamilyName f2 2023-02-08 13:03:06,695 INFO [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] regionserver.HStore(310): Store=4fab3b755525525a1b3d8c1e9b5f1662/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:06,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:06,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fff00124cd01a9a3f626404ca9571f87; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74950407, jitterRate=0.11684809625148773}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:06,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:06,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fff00124cd01a9a3f626404ca9571f87: Running coprocessor pre-open hook at 1675861386665Writing region info on filesystem at 1675861386665Initializing all the Stores at 1675861386665Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386665Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386665Cleaning up temporary data from old regions at 1675861386675 (+10 ms)Cleaning up detritus from prior splits at 1675861386675Running coprocessor post-open hooks at 1675861386697 (+22 ms)Region opened successfully at 1675861386697 2023-02-08 13:03:06,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87., pid=25, masterSystemTime=1675861386618 2023-02-08 13:03:06,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:06,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:06,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:06,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 339eb211e42ee5c15cac8e475de59e5d, NAME => 'testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-08 13:03:06,701 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=fff00124cd01a9a3f626404ca9571f87, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:06,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:06,701 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386701"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861386701"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861386701"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861386701"}]},"ts":"1675861386701"} 2023-02-08 13:03:06,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:06,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:06,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:06,703 INFO [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:06,705 DEBUG [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f1 2023-02-08 13:03:06,705 DEBUG [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f1 2023-02-08 13:03:06,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=18 2023-02-08 13:03:06,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=18, state=SUCCESS; OpenRegionProcedure fff00124cd01a9a3f626404ca9571f87, server=jenkins-hbase4.apache.org,40021,1675861384560 in 234 msec 2023-02-08 13:03:06,706 INFO [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 339eb211e42ee5c15cac8e475de59e5d columnFamilyName f1 2023-02-08 13:03:06,707 INFO [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] regionserver.HStore(310): Store=339eb211e42ee5c15cac8e475de59e5d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,707 INFO [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:06,707 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fff00124cd01a9a3f626404ca9571f87, ASSIGN in 401 msec 2023-02-08 13:03:06,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:06,708 DEBUG [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f2 2023-02-08 13:03:06,708 DEBUG [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f2 2023-02-08 13:03:06,709 INFO [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 339eb211e42ee5c15cac8e475de59e5d columnFamilyName f2 2023-02-08 13:03:06,716 INFO [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] regionserver.HStore(310): Store=339eb211e42ee5c15cac8e475de59e5d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:06,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:06,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:06,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4fab3b755525525a1b3d8c1e9b5f1662/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:06,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:06,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4fab3b755525525a1b3d8c1e9b5f1662; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69421813, jitterRate=0.03446562588214874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:06,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4fab3b755525525a1b3d8c1e9b5f1662: Running coprocessor pre-open hook at 1675861386681Writing region info on filesystem at 1675861386681Initializing all the Stores at 1675861386682 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386682Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386683 (+1 ms)Cleaning up temporary data from old regions at 1675861386698 (+15 ms)Cleaning up detritus from prior splits at 1675861386699 (+1 ms)Running coprocessor post-open hooks at 1675861386721 (+22 ms)Region opened successfully at 1675861386721 2023-02-08 13:03:06,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662., pid=30, masterSystemTime=1675861386634 2023-02-08 13:03:06,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:06,724 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4fab3b755525525a1b3d8c1e9b5f1662, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:06,724 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861386724"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861386724"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861386724"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861386724"}]},"ts":"1675861386724"} 2023-02-08 13:03:06,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:06,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:06,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:06,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4e985e29dd592f319583db6f3f6cf869, NAME => 'testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-08 13:03:06,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:06,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:06,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:06,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:06,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-08 13:03:06,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure 4fab3b755525525a1b3d8c1e9b5f1662, server=jenkins-hbase4.apache.org,39709,1675861384522 in 240 msec 2023-02-08 13:03:06,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4fab3b755525525a1b3d8c1e9b5f1662, ASSIGN in 424 msec 2023-02-08 13:03:06,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:06,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 339eb211e42ee5c15cac8e475de59e5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67261678, jitterRate=0.0022771060466766357}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:06,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 339eb211e42ee5c15cac8e475de59e5d: Running coprocessor pre-open hook at 1675861386702Writing region info on filesystem at 1675861386702Initializing all the Stores at 1675861386703 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386703Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386703Cleaning up temporary data from old regions at 1675861386719 (+16 ms)Cleaning up detritus from prior splits at 1675861386720 (+1 ms)Running coprocessor post-open hooks at 1675861386731 (+11 ms)Region opened successfully at 1675861386731 2023-02-08 13:03:06,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d., pid=21, masterSystemTime=1675861386618 2023-02-08 13:03:06,732 INFO [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:06,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:06,734 DEBUG [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4e985e29dd592f319583db6f3f6cf869/f1 2023-02-08 13:03:06,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:06,734 DEBUG [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4e985e29dd592f319583db6f3f6cf869/f1 2023-02-08 13:03:06,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:06,734 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=339eb211e42ee5c15cac8e475de59e5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:06,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6b402cc95a33009ae614fee264ac5d90, NAME => 'testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-08 13:03:06,734 INFO [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e985e29dd592f319583db6f3f6cf869 columnFamilyName f1 2023-02-08 13:03:06,734 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386734"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861386734"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861386734"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861386734"}]},"ts":"1675861386734"} 2023-02-08 13:03:06,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:06,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:06,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:06,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:06,735 INFO [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] regionserver.HStore(310): Store=4e985e29dd592f319583db6f3f6cf869/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,735 INFO [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:06,736 DEBUG [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4e985e29dd592f319583db6f3f6cf869/f2 2023-02-08 13:03:06,736 DEBUG [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4e985e29dd592f319583db6f3f6cf869/f2 2023-02-08 13:03:06,737 INFO [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:06,737 INFO [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e985e29dd592f319583db6f3f6cf869 columnFamilyName f2 2023-02-08 13:03:06,738 INFO [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] regionserver.HStore(310): Store=4e985e29dd592f319583db6f3f6cf869/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-08 13:03:06,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure 339eb211e42ee5c15cac8e475de59e5d, server=jenkins-hbase4.apache.org,40021,1675861384560 in 273 msec 2023-02-08 13:03:06,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:06,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:06,740 DEBUG [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f1 2023-02-08 13:03:06,740 DEBUG [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f1 2023-02-08 13:03:06,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=339eb211e42ee5c15cac8e475de59e5d, ASSIGN in 435 msec 2023-02-08 13:03:06,740 INFO [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b402cc95a33009ae614fee264ac5d90 columnFamilyName f1 2023-02-08 13:03:06,741 INFO [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] regionserver.HStore(310): Store=6b402cc95a33009ae614fee264ac5d90/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,741 INFO [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:06,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:06,743 DEBUG [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f2 2023-02-08 13:03:06,743 DEBUG [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f2 2023-02-08 13:03:06,743 INFO [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b402cc95a33009ae614fee264ac5d90 columnFamilyName f2 2023-02-08 13:03:06,743 INFO [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] regionserver.HStore(310): Store=6b402cc95a33009ae614fee264ac5d90/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:06,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:06,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:06,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4e985e29dd592f319583db6f3f6cf869/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:06,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4e985e29dd592f319583db6f3f6cf869; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63343629, jitterRate=-0.05610637366771698}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:06,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4e985e29dd592f319583db6f3f6cf869: Running coprocessor pre-open hook at 1675861386725Writing region info on filesystem at 1675861386725Initializing all the Stores at 1675861386726 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386726Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386732 (+6 ms)Cleaning up temporary data from old regions at 1675861386741 (+9 ms)Cleaning up detritus from prior splits at 1675861386741Running coprocessor post-open hooks at 1675861386747 (+6 ms)Region opened successfully at 1675861386747 2023-02-08 13:03:06,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:06,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869., pid=26, masterSystemTime=1675861386634 2023-02-08 13:03:06,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:06,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:06,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:06,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:06,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a130a58e526c1ec31f1634967d9c6aa4, NAME => 'testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-08 13:03:06,750 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4e985e29dd592f319583db6f3f6cf869, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:06,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:06,750 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675861386750"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861386750"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861386750"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861386750"}]},"ts":"1675861386750"} 2023-02-08 13:03:06,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:06,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:06,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:06,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:06,752 INFO [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:06,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6b402cc95a33009ae614fee264ac5d90; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69663488, jitterRate=0.038066864013671875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:06,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6b402cc95a33009ae614fee264ac5d90: Running coprocessor pre-open hook at 1675861386735Writing region info on filesystem at 1675861386735Initializing all the Stores at 1675861386736 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386736Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386736Cleaning up temporary data from old regions at 1675861386745 (+9 ms)Cleaning up detritus from prior splits at 1675861386746 (+1 ms)Running coprocessor post-open hooks at 1675861386753 (+7 ms)Region opened successfully at 1675861386753 2023-02-08 13:03:06,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90., pid=24, masterSystemTime=1675861386618 2023-02-08 13:03:06,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-08 13:03:06,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure 4e985e29dd592f319583db6f3f6cf869, server=jenkins-hbase4.apache.org,39709,1675861384522 in 276 msec 2023-02-08 13:03:06,755 DEBUG [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f1 2023-02-08 13:03:06,755 DEBUG [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f1 2023-02-08 13:03:06,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:06,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:06,756 INFO [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a130a58e526c1ec31f1634967d9c6aa4 columnFamilyName f1 2023-02-08 13:03:06,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4e985e29dd592f319583db6f3f6cf869, ASSIGN in 450 msec 2023-02-08 13:03:06,756 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=6b402cc95a33009ae614fee264ac5d90, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:06,756 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386756"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861386756"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861386756"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861386756"}]},"ts":"1675861386756"} 2023-02-08 13:03:06,756 INFO [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] regionserver.HStore(310): Store=a130a58e526c1ec31f1634967d9c6aa4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,757 INFO [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:06,758 DEBUG [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f2 2023-02-08 13:03:06,758 DEBUG [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f2 2023-02-08 13:03:06,759 INFO [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a130a58e526c1ec31f1634967d9c6aa4 columnFamilyName f2 2023-02-08 13:03:06,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=19 2023-02-08 13:03:06,759 INFO [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] regionserver.HStore(310): Store=a130a58e526c1ec31f1634967d9c6aa4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:06,760 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=19, state=SUCCESS; OpenRegionProcedure 6b402cc95a33009ae614fee264ac5d90, server=jenkins-hbase4.apache.org,40021,1675861384560 in 290 msec 2023-02-08 13:03:06,761 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6b402cc95a33009ae614fee264ac5d90, ASSIGN in 456 msec 2023-02-08 13:03:06,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:06,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:06,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:06,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:06,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:06,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a130a58e526c1ec31f1634967d9c6aa4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73622321, jitterRate=0.09705807268619537}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:06,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a130a58e526c1ec31f1634967d9c6aa4: Running coprocessor pre-open hook at 1675861386751Writing region info on filesystem at 1675861386751Initializing all the Stores at 1675861386752 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386752Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861386752Cleaning up temporary data from old regions at 1675861386762 (+10 ms)Cleaning up detritus from prior splits at 1675861386762Running coprocessor post-open hooks at 1675861386767 (+5 ms)Region opened successfully at 1675861386767 2023-02-08 13:03:06,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4., pid=29, masterSystemTime=1675861386634 2023-02-08 13:03:06,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:06,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:06,770 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a130a58e526c1ec31f1634967d9c6aa4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:06,770 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675861386770"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861386770"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861386770"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861386770"}]},"ts":"1675861386770"} 2023-02-08 13:03:06,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-08 13:03:06,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure a130a58e526c1ec31f1634967d9c6aa4, server=jenkins-hbase4.apache.org,39709,1675861384522 in 289 msec 2023-02-08 13:03:06,774 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-08 13:03:06,774 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a130a58e526c1ec31f1634967d9c6aa4, ASSIGN in 469 msec 2023-02-08 13:03:06,775 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:03:06,775 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861386775"}]},"ts":"1675861386775"} 2023-02-08 13:03:06,776 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-08 13:03:06,778 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:03:06,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 965 msec 2023-02-08 13:03:06,936 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:06,936 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:06,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:06,938 INFO [Listener at localhost/46349] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-08 13:03:06,938 DEBUG [Listener at localhost/46349] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-08 13:03:06,939 INFO [Listener at localhost/46349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:03:06,942 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-08 13:03:06,943 INFO [Listener at localhost/46349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:03:06,943 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-08 13:03:06,943 INFO [Listener at localhost/46349] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 13:03:06,997 DEBUG [hconnection-0xb0acbfc-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:07,017 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55512, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:07,018 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39709] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:07,030 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40021] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:07,149 INFO [Listener at localhost/46349] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 13:03:07,150 INFO [Listener at localhost/46349] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 13:03:07,150 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:07,150 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:07,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 13:03:07,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675861387151 (current time:1675861387151). 2023-02-08 13:03:07,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 13:03:07,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] zookeeper.ReadOnlyZKClient(139): Connect 0x3685eb61 to 127.0.0.1:64909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:07,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c253948, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:07,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:07,162 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53456, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:07,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3685eb61 to 127.0.0.1:64909 2023-02-08 13:03:07,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:07,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 13:03:07,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 13:03:07,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 13:03:07,168 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 13:03:07,168 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675861987168 2023-02-08 13:03:07,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 13:03:07,169 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-08 13:03:07,172 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 13:03:07,173 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 13:03:07,173 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 13:03:07,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 13:03:07,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 7 msec 2023-02-08 13:03:07,175 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 13:03:07,176 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675861987176 2023-02-08 13:03:07,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,212 INFO [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-08 13:03:07,212 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:07,213 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-08 13:03:07,213 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-08 13:03:07,267 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,267 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,269 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:07,270 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:07,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:07,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:07,270 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:07,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:07,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:07,270 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:07,270 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:07,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,270 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:07,271 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:03:07,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-08 13:03:07,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,271 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-08 13:03:07,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-08 13:03:07,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,272 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-08 13:03:07,272 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-08 13:03:07,272 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:07,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,273 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-08 13:03:07,273 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-08 13:03:07,273 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:07,273 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-08 13:03:07,274 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:07,273 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40021,1675861384560' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-08 13:03:07,274 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-08 13:03:07,274 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-08 13:03:07,274 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1675861384522' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-08 13:03:07,273 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:07,275 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:07,276 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:07,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:07,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:07,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:07,276 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 13:03:07,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:03:07,277 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 13:03:07,277 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,277 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,277 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:07,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:07,277 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:07,277 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,277 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:07,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:07,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:07,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:07,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:07,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40021,1675861384560' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-08 13:03:07,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a8a61a9[Count = 1] remaining members to acquire global barrier 2023-02-08 13:03:07,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:07,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:07,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:07,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:07,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:07,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:07,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:07,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:07,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39709,1675861384522' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-08 13:03:07,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a8a61a9[Count = 0] remaining members to acquire global barrier 2023-02-08 13:03:07,285 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-08 13:03:07,285 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,286 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,286 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,286 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:07,286 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-08 13:03:07,286 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-08 13:03:07,287 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:07,287 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:03:07,287 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:07,287 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. started... 2023-02-08 13:03:07,287 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:07,287 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. started... 2023-02-08 13:03:07,287 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:07,287 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. started... 2023-02-08 13:03:07,288 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a130a58e526c1ec31f1634967d9c6aa4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:03:07,288 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 86ea3299ee0b3655463ad474dbd2e36b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:03:07,289 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-08 13:03:07,289 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 13:03:07,289 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:07,289 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3c61a4344edb4e7db2fd002a7a51fdbb 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-08 13:03:07,289 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. started... 2023-02-08 13:03:07,292 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 29c979748dd245a848d7f00e7e64d7a3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:03:07,296 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-08 13:03:07,296 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 13:03:07,296 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:07,296 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:07,296 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. started... 2023-02-08 13:03:07,296 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. started... 2023-02-08 13:03:07,297 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HRegion(2744): Flushing fff00124cd01a9a3f626404ca9571f87 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:03:07,298 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 0f324c53feb5004dc32970d166e42a4a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:03:07,379 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/.tmp/f1/334a346dadcb4ff09b4351104b6fbb6a 2023-02-08 13:03:07,388 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-08 13:03:07,400 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/.tmp/f1/ca1355e03fa0462b8e1b5748b359b748 2023-02-08 13:03:07,460 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/.tmp/f1/f35e06abdc664976b7b62bb1910e3b27 2023-02-08 13:03:07,466 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/.tmp/f1/badad35939b34a2c9725b23b971625b9 2023-02-08 13:03:07,467 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/.tmp/f1/1612d3ec613f49e48f78db5cc174395b 2023-02-08 13:03:07,467 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/.tmp/f1/a89e740c0eb8466fbba058a061cb3845 2023-02-08 13:03:07,477 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:07,477 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:07,477 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:07,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 13:03:07,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:03:07,483 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-08 13:03:07,563 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/.tmp/f2/719c54cfb2594295a6e9395e2e7ca0b4 2023-02-08 13:03:07,572 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/.tmp/f1/ca1355e03fa0462b8e1b5748b359b748 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f1/ca1355e03fa0462b8e1b5748b359b748 2023-02-08 13:03:07,576 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/.tmp/f2/9411de22e6924c8eacda512a5ec4f59a 2023-02-08 13:03:07,581 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f1/ca1355e03fa0462b8e1b5748b359b748, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 13:03:07,582 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/.tmp/f2/719c54cfb2594295a6e9395e2e7ca0b4 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f2/719c54cfb2594295a6e9395e2e7ca0b4 2023-02-08 13:03:07,587 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/.tmp/f1/badad35939b34a2c9725b23b971625b9 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f1/badad35939b34a2c9725b23b971625b9 2023-02-08 13:03:07,599 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/.tmp/f2/7f74ff48586947148fd2a3cb09a43f3f 2023-02-08 13:03:07,602 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f2/719c54cfb2594295a6e9395e2e7ca0b4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 13:03:07,603 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 3c61a4344edb4e7db2fd002a7a51fdbb in 314ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:07,603 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-08 13:03:07,605 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3c61a4344edb4e7db2fd002a7a51fdbb: 2023-02-08 13:03:07,605 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,606 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:07,606 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f1/ca1355e03fa0462b8e1b5748b359b748] hfiles 2023-02-08 13:03:07,606 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f1/ca1355e03fa0462b8e1b5748b359b748 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,606 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f2/719c54cfb2594295a6e9395e2e7ca0b4] hfiles 2023-02-08 13:03:07,606 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f2/719c54cfb2594295a6e9395e2e7ca0b4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,607 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f1/badad35939b34a2c9725b23b971625b9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:07,608 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/.tmp/f2/9411de22e6924c8eacda512a5ec4f59a as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f2/9411de22e6924c8eacda512a5ec4f59a 2023-02-08 13:03:07,616 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f2/9411de22e6924c8eacda512a5ec4f59a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:07,617 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for fff00124cd01a9a3f626404ca9571f87 in 320ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:07,620 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/.tmp/f1/1612d3ec613f49e48f78db5cc174395b as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f1/1612d3ec613f49e48f78db5cc174395b 2023-02-08 13:03:07,628 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f1/1612d3ec613f49e48f78db5cc174395b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:07,629 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/.tmp/f2/7f74ff48586947148fd2a3cb09a43f3f as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f2/7f74ff48586947148fd2a3cb09a43f3f 2023-02-08 13:03:07,634 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for fff00124cd01a9a3f626404ca9571f87: 2023-02-08 13:03:07,635 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/.tmp/f2/5093633174924f4e9bc85ac344548377 2023-02-08 13:03:07,635 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,635 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:07,635 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f1/badad35939b34a2c9725b23b971625b9] hfiles 2023-02-08 13:03:07,635 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f1/badad35939b34a2c9725b23b971625b9 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,635 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f2/9411de22e6924c8eacda512a5ec4f59a] hfiles 2023-02-08 13:03:07,635 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f2/9411de22e6924c8eacda512a5ec4f59a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,641 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f2/7f74ff48586947148fd2a3cb09a43f3f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:07,642 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 86ea3299ee0b3655463ad474dbd2e36b in 354ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:07,642 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 86ea3299ee0b3655463ad474dbd2e36b: 2023-02-08 13:03:07,642 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,642 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:07,642 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f1/1612d3ec613f49e48f78db5cc174395b] hfiles 2023-02-08 13:03:07,642 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f1/1612d3ec613f49e48f78db5cc174395b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,642 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f2/7f74ff48586947148fd2a3cb09a43f3f] hfiles 2023-02-08 13:03:07,642 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f2/7f74ff48586947148fd2a3cb09a43f3f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,644 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/.tmp/f2/9381fb57791f42be9cd3fbe07593782d 2023-02-08 13:03:07,648 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/.tmp/f2/b8637ffc828b4a2189edf8601d1e194f 2023-02-08 13:03:07,652 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/.tmp/f1/334a346dadcb4ff09b4351104b6fbb6a as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f1/334a346dadcb4ff09b4351104b6fbb6a 2023-02-08 13:03:07,654 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/.tmp/f1/a89e740c0eb8466fbba058a061cb3845 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f1/a89e740c0eb8466fbba058a061cb3845 2023-02-08 13:03:07,656 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/.tmp/f1/f35e06abdc664976b7b62bb1910e3b27 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f1/f35e06abdc664976b7b62bb1910e3b27 2023-02-08 13:03:07,661 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f1/334a346dadcb4ff09b4351104b6fbb6a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:07,662 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/.tmp/f2/9381fb57791f42be9cd3fbe07593782d as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f2/9381fb57791f42be9cd3fbe07593782d 2023-02-08 13:03:07,675 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f1/a89e740c0eb8466fbba058a061cb3845, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:07,676 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/.tmp/f2/5093633174924f4e9bc85ac344548377 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f2/5093633174924f4e9bc85ac344548377 2023-02-08 13:03:07,679 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f1/f35e06abdc664976b7b62bb1910e3b27, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:07,681 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/.tmp/f2/b8637ffc828b4a2189edf8601d1e194f as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f2/b8637ffc828b4a2189edf8601d1e194f 2023-02-08 13:03:07,696 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f2/9381fb57791f42be9cd3fbe07593782d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:07,705 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a130a58e526c1ec31f1634967d9c6aa4 in 417ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:07,706 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a130a58e526c1ec31f1634967d9c6aa4: 2023-02-08 13:03:07,706 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,706 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:07,706 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f1/334a346dadcb4ff09b4351104b6fbb6a] hfiles 2023-02-08 13:03:07,706 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f1/334a346dadcb4ff09b4351104b6fbb6a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,706 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f2/9381fb57791f42be9cd3fbe07593782d] hfiles 2023-02-08 13:03:07,706 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f2/9381fb57791f42be9cd3fbe07593782d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,710 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. completed. 2023-02-08 13:03:07,710 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:07,710 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:07,710 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. started... 2023-02-08 13:03:07,714 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4fab3b755525525a1b3d8c1e9b5f1662: 2023-02-08 13:03:07,714 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,714 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:07,714 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 13:03:07,714 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 13:03:07,720 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-08 13:03:07,721 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f2/b8637ffc828b4a2189edf8601d1e194f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:07,722 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0f324c53feb5004dc32970d166e42a4a in 424ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:07,722 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 0f324c53feb5004dc32970d166e42a4a: 2023-02-08 13:03:07,722 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,722 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:07,722 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f1/f35e06abdc664976b7b62bb1910e3b27] hfiles 2023-02-08 13:03:07,722 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f1/f35e06abdc664976b7b62bb1910e3b27 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,722 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f2/b8637ffc828b4a2189edf8601d1e194f] hfiles 2023-02-08 13:03:07,722 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f2/b8637ffc828b4a2189edf8601d1e194f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,724 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. completed. 2023-02-08 13:03:07,724 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:07,724 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:07,724 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-08 13:03:07,724 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. started... 2023-02-08 13:03:07,725 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 339eb211e42ee5c15cac8e475de59e5d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:03:07,735 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. completed. 2023-02-08 13:03:07,735 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:07,735 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:07,735 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. started... 2023-02-08 13:03:07,735 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-08 13:03:07,735 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 6b402cc95a33009ae614fee264ac5d90 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-08 13:03:07,736 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f2/5093633174924f4e9bc85ac344548377, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:07,748 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 29c979748dd245a848d7f00e7e64d7a3 in 456ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:07,748 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 29c979748dd245a848d7f00e7e64d7a3: 2023-02-08 13:03:07,749 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,749 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:07,749 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f1/a89e740c0eb8466fbba058a061cb3845] hfiles 2023-02-08 13:03:07,749 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f1/a89e740c0eb8466fbba058a061cb3845 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,749 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f2/5093633174924f4e9bc85ac344548377] hfiles 2023-02-08 13:03:07,749 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f2/5093633174924f4e9bc85ac344548377 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,785 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:07,791 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:07,791 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:07,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 13:03:07,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:03:07,799 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-08 13:03:07,817 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. completed. 2023-02-08 13:03:07,817 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:07,817 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-08 13:03:07,824 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/.tmp/f1/fccc50ebcb314f10a4d5f6648b42d506 2023-02-08 13:03:07,827 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. completed. 2023-02-08 13:03:07,827 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:07,827 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:07,827 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. started... 2023-02-08 13:03:07,827 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 4e985e29dd592f319583db6f3f6cf869: 2023-02-08 13:03:07,827 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,828 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:07,828 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 13:03:07,828 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 13:03:07,828 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-08 13:03:07,830 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. completed. 2023-02-08 13:03:07,830 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:07,830 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-08 13:03:07,837 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. completed. 2023-02-08 13:03:07,837 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:07,837 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-08 13:03:07,843 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. completed. 2023-02-08 13:03:07,843 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:07,843 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-08 13:03:07,843 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-08 13:03:07,843 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:07,843 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-08 13:03:07,843 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,39709,1675861384522' in zk 2023-02-08 13:03:07,846 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-08 13:03:07,846 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:07,846 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/.tmp/f2/de28bf4f4b784e5081e2a713b0a08772 2023-02-08 13:03:07,846 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:07,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:07,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:07,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:07,846 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-08 13:03:07,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:07,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:07,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:07,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:07,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:07,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,39709,1675861384522': 2023-02-08 13:03:07,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39709,1675861384522' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-08 13:03:07,855 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/.tmp/f1/fccc50ebcb314f10a4d5f6648b42d506 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f1/fccc50ebcb314f10a4d5f6648b42d506 2023-02-08 13:03:07,861 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f1/fccc50ebcb314f10a4d5f6648b42d506, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:07,862 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/.tmp/f2/de28bf4f4b784e5081e2a713b0a08772 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f2/de28bf4f4b784e5081e2a713b0a08772 2023-02-08 13:03:07,877 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f2/de28bf4f4b784e5081e2a713b0a08772, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:07,878 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 339eb211e42ee5c15cac8e475de59e5d in 154ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:07,879 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 339eb211e42ee5c15cac8e475de59e5d: 2023-02-08 13:03:07,879 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,879 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:07,879 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f1/fccc50ebcb314f10a4d5f6648b42d506] hfiles 2023-02-08 13:03:07,879 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f1/fccc50ebcb314f10a4d5f6648b42d506 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,879 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f2/de28bf4f4b784e5081e2a713b0a08772] hfiles 2023-02-08 13:03:07,879 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f2/de28bf4f4b784e5081e2a713b0a08772 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:07,891 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. completed. 2023-02-08 13:03:07,891 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:07,891 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-08 13:03:08,234 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/.tmp/f1/f6c0bc174ad3496582b65229322fd695 2023-02-08 13:03:08,251 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/.tmp/f2/e6fff3008cd84e5aabe5edb04cc568bf 2023-02-08 13:03:08,257 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/.tmp/f1/f6c0bc174ad3496582b65229322fd695 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f1/f6c0bc174ad3496582b65229322fd695 2023-02-08 13:03:08,262 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f1/f6c0bc174ad3496582b65229322fd695, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 13:03:08,263 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/.tmp/f2/e6fff3008cd84e5aabe5edb04cc568bf as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f2/e6fff3008cd84e5aabe5edb04cc568bf 2023-02-08 13:03:08,268 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f2/e6fff3008cd84e5aabe5edb04cc568bf, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 13:03:08,268 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 6b402cc95a33009ae614fee264ac5d90 in 533ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:08,269 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 6b402cc95a33009ae614fee264ac5d90: 2023-02-08 13:03:08,269 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,269 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:08,269 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f1/f6c0bc174ad3496582b65229322fd695] hfiles 2023-02-08 13:03:08,269 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f1/f6c0bc174ad3496582b65229322fd695 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,269 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f2/e6fff3008cd84e5aabe5edb04cc568bf] hfiles 2023-02-08 13:03:08,269 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f2/e6fff3008cd84e5aabe5edb04cc568bf for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,282 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. completed. 2023-02-08 13:03:08,282 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:08,282 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-08 13:03:08,282 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-08 13:03:08,282 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:08,283 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-08 13:03:08,283 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,40021,1675861384560' in zk 2023-02-08 13:03:08,284 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-08 13:03:08,284 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:08,284 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:08,284 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-08 13:03:08,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:08,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:08,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:08,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:08,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:08,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:08,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:08,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:08,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:08,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:08,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,40021,1675861384560': 2023-02-08 13:03:08,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40021,1675861384560' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-08 13:03:08,289 INFO [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-08 13:03:08,289 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:03:08,289 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:03:08,289 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,289 INFO [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 13:03:08,291 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,291 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,291 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:08,291 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:08,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:08,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,292 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:08,291 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:08,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:08,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:08,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:08,292 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:08,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:08,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:08,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:08,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,294 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:08,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:08,294 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:08,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:08,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:08,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:08,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:08,299 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:08,299 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:08,299 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:08,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 13:03:08,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:03:08,301 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-08 13:03:08,302 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:08,302 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,302 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:08,302 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:08,302 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:08,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:08,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:08,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:08,302 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:08,302 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:08,302 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:08,302 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,302 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:08,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:08,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:08,303 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:08,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion because node does not exist (not an error) 2023-02-08 13:03:08,304 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,304 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:08,304 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,304 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:08,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:08,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,779 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-08 13:03:08,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,780 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:08,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675861387169Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675861388303 (+1134 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1675861388304 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1675861388321 (+17 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675861388736 (+415 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1675861388779 (+43 ms) 2023-02-08 13:03:08,781 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 13:03:08,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.6090 sec 2023-02-08 13:03:09,301 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:09,301 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:09,301 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:09,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 13:03:09,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 13:03:09,303 INFO [Listener at localhost/46349] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 13:03:09,303 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:09,303 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:09,309 INFO [Listener at localhost/46349] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 13:03:09,521 INFO [Listener at localhost/46349] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 13:03:09,557 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39709] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:09,568 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40021] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:09,637 INFO [Listener at localhost/46349] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 13:03:09,641 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:09,641 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:09,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 13:03:09,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-08 13:03:09,647 INFO [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-08 13:03:09,647 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:09,648 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-08 13:03:09,648 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-08 13:03:09,648 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:09,648 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:09,650 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:09,650 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:09,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:09,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:09,650 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:09,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:09,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:09,650 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:09,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:09,651 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:09,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:09,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:09,651 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:09,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:09,651 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:03:09,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:03:09,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:09,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:03:09,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:09,652 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-08 13:03:09,652 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-08 13:03:09,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-08 13:03:09,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-08 13:03:09,655 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-08 13:03:09,655 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-08 13:03:09,655 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:09,655 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:09,656 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-08 13:03:09,657 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-08 13:03:09,658 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:09,658 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. started... 2023-02-08 13:03:09,658 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:09,658 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:09,658 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. started... 2023-02-08 13:03:09,658 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 86ea3299ee0b3655463ad474dbd2e36b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:03:09,658 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. started... 2023-02-08 13:03:09,658 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a130a58e526c1ec31f1634967d9c6aa4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:03:09,658 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3c61a4344edb4e7db2fd002a7a51fdbb 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-08 13:03:09,659 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-08 13:03:09,659 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 13:03:09,659 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:09,659 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. started... 2023-02-08 13:03:09,659 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 29c979748dd245a848d7f00e7e64d7a3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:03:09,660 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-08 13:03:09,660 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 13:03:09,660 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:09,660 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. started... 2023-02-08 13:03:09,660 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0f324c53feb5004dc32970d166e42a4a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:03:09,661 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:09,661 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. started... 2023-02-08 13:03:09,661 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fff00124cd01a9a3f626404ca9571f87 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:03:09,699 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/.tmp/f1/9044b3c934b440de86b3320aff8984c8 2023-02-08 13:03:09,705 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/.tmp/f1/7b2a7b49ea634f2890c000f03777aded 2023-02-08 13:03:09,709 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/.tmp/f1/fe62f08ef93d4f08bbce4e7ea435b7b6 2023-02-08 13:03:09,736 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/.tmp/f1/9b88792decf24126b2cec1c1fd342c05 2023-02-08 13:03:09,744 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/.tmp/f1/3f35f85e51a6405fb9692f25063c5310 2023-02-08 13:03:09,748 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/.tmp/f1/8762a39ba7154a47ba07cec40d4d4ba1 2023-02-08 13:03:09,760 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/.tmp/f2/fe6c068d1ad24c23916763ad1b2e64ba 2023-02-08 13:03:09,766 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/.tmp/f1/7b2a7b49ea634f2890c000f03777aded as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f1/7b2a7b49ea634f2890c000f03777aded 2023-02-08 13:03:09,770 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/.tmp/f2/825887947ae2464a9e4b75379b59cd40 2023-02-08 13:03:09,771 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f1/7b2a7b49ea634f2890c000f03777aded, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:09,777 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/.tmp/f1/9044b3c934b440de86b3320aff8984c8 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f1/9044b3c934b440de86b3320aff8984c8 2023-02-08 13:03:09,784 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/.tmp/f2/425c1a17162a47628604b75664a0859a 2023-02-08 13:03:09,789 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/.tmp/f2/fe6c068d1ad24c23916763ad1b2e64ba as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f2/fe6c068d1ad24c23916763ad1b2e64ba 2023-02-08 13:03:09,791 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/.tmp/f2/af1e09e2e2034448b49ef3bf3f73bd4e 2023-02-08 13:03:09,792 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f1/9044b3c934b440de86b3320aff8984c8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:09,793 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/.tmp/f2/825887947ae2464a9e4b75379b59cd40 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f2/825887947ae2464a9e4b75379b59cd40 2023-02-08 13:03:09,794 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/.tmp/f1/fe62f08ef93d4f08bbce4e7ea435b7b6 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f1/fe62f08ef93d4f08bbce4e7ea435b7b6 2023-02-08 13:03:09,796 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f2/fe6c068d1ad24c23916763ad1b2e64ba, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:09,797 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 29c979748dd245a848d7f00e7e64d7a3 in 138ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:09,797 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 29c979748dd245a848d7f00e7e64d7a3: 2023-02-08 13:03:09,797 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:09,798 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:09,798 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-08 13:03:09,798 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. started... 2023-02-08 13:03:09,798 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4fab3b755525525a1b3d8c1e9b5f1662: 2023-02-08 13:03:09,798 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:09,798 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:09,798 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. started... 2023-02-08 13:03:09,798 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-08 13:03:09,798 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4e985e29dd592f319583db6f3f6cf869: 2023-02-08 13:03:09,798 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:09,798 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-08 13:03:09,799 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/.tmp/f1/3f35f85e51a6405fb9692f25063c5310 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f1/3f35f85e51a6405fb9692f25063c5310 2023-02-08 13:03:09,800 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f2/825887947ae2464a9e4b75379b59cd40, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:09,803 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0f324c53feb5004dc32970d166e42a4a in 142ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:09,803 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0f324c53feb5004dc32970d166e42a4a: 2023-02-08 13:03:09,803 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:09,812 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/.tmp/f2/811d19d9fc59457996f79a5e0375e931 2023-02-08 13:03:09,812 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:09,812 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-08 13:03:09,812 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. started... 2023-02-08 13:03:09,813 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 339eb211e42ee5c15cac8e475de59e5d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:03:09,820 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f1/3f35f85e51a6405fb9692f25063c5310, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:09,822 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/.tmp/f2/af1e09e2e2034448b49ef3bf3f73bd4e as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f2/af1e09e2e2034448b49ef3bf3f73bd4e 2023-02-08 13:03:09,822 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f1/fe62f08ef93d4f08bbce4e7ea435b7b6, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 13:03:09,823 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/.tmp/f2/393d9acff88547b988a7741995c768bb 2023-02-08 13:03:09,825 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/.tmp/f2/425c1a17162a47628604b75664a0859a as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f2/425c1a17162a47628604b75664a0859a 2023-02-08 13:03:09,828 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/.tmp/f1/9b88792decf24126b2cec1c1fd342c05 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f1/9b88792decf24126b2cec1c1fd342c05 2023-02-08 13:03:09,832 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f2/af1e09e2e2034448b49ef3bf3f73bd4e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:09,833 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f2/425c1a17162a47628604b75664a0859a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 13:03:09,834 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 86ea3299ee0b3655463ad474dbd2e36b in 176ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:09,834 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 86ea3299ee0b3655463ad474dbd2e36b: 2023-02-08 13:03:09,834 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:09,834 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-08 13:03:09,834 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 3c61a4344edb4e7db2fd002a7a51fdbb in 176ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:09,834 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3c61a4344edb4e7db2fd002a7a51fdbb: 2023-02-08 13:03:09,834 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:09,834 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-08 13:03:09,835 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:09,835 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. started... 2023-02-08 13:03:09,835 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6b402cc95a33009ae614fee264ac5d90 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-08 13:03:09,837 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f1/9b88792decf24126b2cec1c1fd342c05, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:09,838 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/.tmp/f2/811d19d9fc59457996f79a5e0375e931 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f2/811d19d9fc59457996f79a5e0375e931 2023-02-08 13:03:09,843 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/.tmp/f1/8762a39ba7154a47ba07cec40d4d4ba1 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f1/8762a39ba7154a47ba07cec40d4d4ba1 2023-02-08 13:03:09,846 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f2/811d19d9fc59457996f79a5e0375e931, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:09,846 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/.tmp/f1/c25543c707594665aaac4287edefa239 2023-02-08 13:03:09,848 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for fff00124cd01a9a3f626404ca9571f87 in 187ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:09,848 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fff00124cd01a9a3f626404ca9571f87: 2023-02-08 13:03:09,848 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:09,848 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-08 13:03:09,858 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f1/8762a39ba7154a47ba07cec40d4d4ba1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:09,860 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/.tmp/f2/393d9acff88547b988a7741995c768bb as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f2/393d9acff88547b988a7741995c768bb 2023-02-08 13:03:09,866 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f2/393d9acff88547b988a7741995c768bb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:09,867 INFO [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a130a58e526c1ec31f1634967d9c6aa4 in 209ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:09,867 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a130a58e526c1ec31f1634967d9c6aa4: 2023-02-08 13:03:09,867 DEBUG [rs(jenkins-hbase4.apache.org,39709,1675861384522)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:09,867 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-08 13:03:09,867 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-08 13:03:09,867 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:09,868 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-08 13:03:09,868 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39709,1675861384522' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-08 13:03:09,869 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:09,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:09,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:09,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:09,870 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:09,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:09,870 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:09,870 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:09,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:09,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:09,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:09,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:09,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39709,1675861384522' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-08 13:03:09,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eb5f420[Count = 1] remaining members to acquire global barrier 2023-02-08 13:03:09,875 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/.tmp/f2/45af73ed39f1430bb7ac899db416645a 2023-02-08 13:03:09,880 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/.tmp/f1/c25543c707594665aaac4287edefa239 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f1/c25543c707594665aaac4287edefa239 2023-02-08 13:03:09,885 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f1/c25543c707594665aaac4287edefa239, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:09,886 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/.tmp/f2/45af73ed39f1430bb7ac899db416645a as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f2/45af73ed39f1430bb7ac899db416645a 2023-02-08 13:03:09,891 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f2/45af73ed39f1430bb7ac899db416645a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:09,892 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 339eb211e42ee5c15cac8e475de59e5d in 79ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:09,892 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 339eb211e42ee5c15cac8e475de59e5d: 2023-02-08 13:03:09,892 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:09,892 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-08 13:03:10,260 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/.tmp/f1/1412cb0101f3447ca937549edf521259 2023-02-08 13:03:10,273 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/.tmp/f2/11330cd1d6864cfbb9bffd1bb2171bb3 2023-02-08 13:03:10,279 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/.tmp/f1/1412cb0101f3447ca937549edf521259 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f1/1412cb0101f3447ca937549edf521259 2023-02-08 13:03:10,285 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f1/1412cb0101f3447ca937549edf521259, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 13:03:10,286 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/.tmp/f2/11330cd1d6864cfbb9bffd1bb2171bb3 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f2/11330cd1d6864cfbb9bffd1bb2171bb3 2023-02-08 13:03:10,291 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f2/11330cd1d6864cfbb9bffd1bb2171bb3, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 13:03:10,292 INFO [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 6b402cc95a33009ae614fee264ac5d90 in 457ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:10,292 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6b402cc95a33009ae614fee264ac5d90: 2023-02-08 13:03:10,292 DEBUG [rs(jenkins-hbase4.apache.org,40021,1675861384560)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:10,292 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-08 13:03:10,293 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-08 13:03:10,293 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,293 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-08 13:03:10,293 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40021,1675861384560' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-08 13:03:10,294 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:10,294 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:10,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:10,295 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:10,295 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:10,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:10,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:10,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:10,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:10,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40021,1675861384560' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-08 13:03:10,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eb5f420[Count = 0] remaining members to acquire global barrier 2023-02-08 13:03:10,297 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-08 13:03:10,297 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:10,299 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:10,299 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:10,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:10,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:10,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:10,299 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,299 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-08 13:03:10,299 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-08 13:03:10,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:10,299 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,39709,1675861384522' in zk 2023-02-08 13:03:10,300 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-08 13:03:10,300 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-08 13:03:10,300 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,300 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:03:10,300 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40021,1675861384560' in zk 2023-02-08 13:03:10,301 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-08 13:03:10,301 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:10,301 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,301 DEBUG [member: 'jenkins-hbase4.apache.org,39709,1675861384522' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-08 13:03:10,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:10,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:10,302 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,302 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-08 13:03:10,302 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:10,302 DEBUG [member: 'jenkins-hbase4.apache.org,40021,1675861384560' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-08 13:03:10,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:10,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:10,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:10,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:10,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:10,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,39709,1675861384522': 2023-02-08 13:03:10,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39709,1675861384522' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-08 13:03:10,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:10,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:10,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:10,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:10,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:10,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:10,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:10,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,40021,1675861384560': 2023-02-08 13:03:10,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40021,1675861384560' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-08 13:03:10,309 INFO [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-08 13:03:10,309 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:03:10,309 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:03:10,309 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-08 13:03:10,309 INFO [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 13:03:10,311 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:10,311 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:10,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:10,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:10,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:10,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:10,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:10,311 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:10,311 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:10,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:10,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:10,311 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:10,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:10,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:10,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:10,311 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:10,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:10,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:10,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:10,312 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:10,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:10,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:10,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:10,315 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:10,315 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,321 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:10,321 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,321 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:10,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:10,321 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:10,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:10,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:10,321 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:10,321 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:10,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-08 13:03:10,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 13:03:10,321 DEBUG [(jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:10,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:10,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:10,321 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:10,322 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:10,322 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,323 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:10,323 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:10,323 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:10,323 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-08 13:03:10,323 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:10,323 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 13:03:10,423 DEBUG [Listener at localhost/46349] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 13:03:10,423 INFO [Listener at localhost/46349] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:10,424 INFO [Listener at localhost/46349] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:10,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35621] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 13:03:10,425 INFO [Listener at localhost/46349] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 13:03:10,426 DEBUG [Listener at localhost/46349] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47637cda to 127.0.0.1:64909 2023-02-08 13:03:10,426 DEBUG [Listener at localhost/46349] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:10,426 DEBUG [Listener at localhost/46349] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 13:03:10,426 DEBUG [Listener at localhost/46349] util.JVMClusterUtil(257): Found active master hash=688324344, stopped=false 2023-02-08 13:03:10,426 INFO [Listener at localhost/46349] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35621,1675861384459 2023-02-08 13:03:10,428 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:10,428 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:10,428 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:10,428 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:10,428 INFO [Listener at localhost/46349] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 13:03:10,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:10,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:10,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:10,430 DEBUG [Listener at localhost/46349] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53d89502 to 127.0.0.1:64909 2023-02-08 13:03:10,430 DEBUG [Listener at localhost/46349] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:10,430 INFO [Listener at localhost/46349] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39709,1675861384522' ***** 2023-02-08 13:03:10,430 INFO [Listener at localhost/46349] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:10,430 INFO [Listener at localhost/46349] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40021,1675861384560' ***** 2023-02-08 13:03:10,431 INFO [Listener at localhost/46349] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:10,431 INFO [RS:1;jenkins-hbase4:40021] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:10,431 INFO [RS:0;jenkins-hbase4:39709] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:10,431 INFO [RS:1;jenkins-hbase4:40021] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:10,431 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:10,431 INFO [RS:1;jenkins-hbase4:40021] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:10,431 INFO [RS:0;jenkins-hbase4:39709] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:10,432 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(3304): Received CLOSE for 3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:10,432 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:10,432 INFO [RS:0;jenkins-hbase4:39709] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:10,433 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(3304): Received CLOSE for 0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:10,433 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(3304): Received CLOSE for 86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:10,433 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(3304): Received CLOSE for fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:10,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3c61a4344edb4e7db2fd002a7a51fdbb, disabling compactions & flushes 2023-02-08 13:03:10,433 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(3304): Received CLOSE for cfdb1186af27595316aea7a5b72c2155 2023-02-08 13:03:10,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:10,433 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(3304): Received CLOSE for 339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:10,433 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(3304): Received CLOSE for a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:10,434 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(3304): Received CLOSE for 6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:10,434 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(3304): Received CLOSE for 29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:10,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 86ea3299ee0b3655463ad474dbd2e36b, disabling compactions & flushes 2023-02-08 13:03:10,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:10,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:10,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. after waiting 0 ms 2023-02-08 13:03:10,434 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(3304): Received CLOSE for 4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:10,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:10,434 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(3304): Received CLOSE for 4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:10,434 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,434 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:10,434 DEBUG [RS:1;jenkins-hbase4:40021] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54d4acd6 to 127.0.0.1:64909 2023-02-08 13:03:10,434 DEBUG [RS:0;jenkins-hbase4:39709] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ad698d7 to 127.0.0.1:64909 2023-02-08 13:03:10,434 DEBUG [RS:1;jenkins-hbase4:40021] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:10,434 DEBUG [RS:0;jenkins-hbase4:39709] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:10,434 INFO [RS:0;jenkins-hbase4:39709] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:10,434 INFO [RS:0;jenkins-hbase4:39709] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:10,434 INFO [RS:0;jenkins-hbase4:39709] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:10,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:10,434 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 13:03:10,434 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-08 13:03:10,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. after waiting 0 ms 2023-02-08 13:03:10,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:10,434 DEBUG [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(1479): Online Regions={3c61a4344edb4e7db2fd002a7a51fdbb=testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb., 0f324c53feb5004dc32970d166e42a4a=testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a., fff00124cd01a9a3f626404ca9571f87=testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87., cfdb1186af27595316aea7a5b72c2155=hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155., 339eb211e42ee5c15cac8e475de59e5d=testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d., 6b402cc95a33009ae614fee264ac5d90=testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90.} 2023-02-08 13:03:10,435 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-08 13:03:10,435 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:03:10,435 DEBUG [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 86ea3299ee0b3655463ad474dbd2e36b=testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b., a130a58e526c1ec31f1634967d9c6aa4=testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4., 29c979748dd245a848d7f00e7e64d7a3=testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3., 4fab3b755525525a1b3d8c1e9b5f1662=testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662., 4e985e29dd592f319583db6f3f6cf869=testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869.} 2023-02-08 13:03:10,436 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:03:10,435 DEBUG [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(1505): Waiting on 0f324c53feb5004dc32970d166e42a4a, 339eb211e42ee5c15cac8e475de59e5d, 3c61a4344edb4e7db2fd002a7a51fdbb, 6b402cc95a33009ae614fee264ac5d90, cfdb1186af27595316aea7a5b72c2155, fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:10,438 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:03:10,438 DEBUG [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1505): Waiting on 1588230740, 29c979748dd245a848d7f00e7e64d7a3, 4e985e29dd592f319583db6f3f6cf869, 4fab3b755525525a1b3d8c1e9b5f1662, 86ea3299ee0b3655463ad474dbd2e36b, a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:10,438 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:03:10,439 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:03:10,440 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-08 13:03:10,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:10,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:10,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:10,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3c61a4344edb4e7db2fd002a7a51fdbb: Waiting for close lock at 1675861390433Running coprocessor pre-close hooks at 1675861390433Disabling compacts and flushes for region at 1675861390433Disabling writes for close at 1675861390434 (+1 ms)Writing region close event to WAL at 1675861390443 (+9 ms)Running coprocessor post-close hooks at 1675861390452 (+9 ms)Closed at 1675861390453 (+1 ms) 2023-02-08 13:03:10,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:10,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:10,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 86ea3299ee0b3655463ad474dbd2e36b: Waiting for close lock at 1675861390434Running coprocessor pre-close hooks at 1675861390434Disabling compacts and flushes for region at 1675861390434Disabling writes for close at 1675861390435 (+1 ms)Writing region close event to WAL at 1675861390444 (+9 ms)Running coprocessor post-close hooks at 1675861390453 (+9 ms)Closed at 1675861390454 (+1 ms) 2023-02-08 13:03:10,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0f324c53feb5004dc32970d166e42a4a, disabling compactions & flushes 2023-02-08 13:03:10,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:10,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:10,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a130a58e526c1ec31f1634967d9c6aa4, disabling compactions & flushes 2023-02-08 13:03:10,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:10,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:10,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:10,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. after waiting 0 ms 2023-02-08 13:03:10,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. after waiting 0 ms 2023-02-08 13:03:10,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:10,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:10,469 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/.tmp/info/a28addfc2c0c468da353f3f8767e7208 2023-02-08 13:03:10,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:10,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:10,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0f324c53feb5004dc32970d166e42a4a: Waiting for close lock at 1675861390454Running coprocessor pre-close hooks at 1675861390454Disabling compacts and flushes for region at 1675861390454Disabling writes for close at 1675861390454Writing region close event to WAL at 1675861390476 (+22 ms)Running coprocessor post-close hooks at 1675861390480 (+4 ms)Closed at 1675861390480 2023-02-08 13:03:10,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:10,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fff00124cd01a9a3f626404ca9571f87, disabling compactions & flushes 2023-02-08 13:03:10,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:10,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:10,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:10,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. after waiting 0 ms 2023-02-08 13:03:10,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:10,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:10,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a130a58e526c1ec31f1634967d9c6aa4: Waiting for close lock at 1675861390454Running coprocessor pre-close hooks at 1675861390454Disabling compacts and flushes for region at 1675861390454Disabling writes for close at 1675861390454Writing region close event to WAL at 1675861390476 (+22 ms)Running coprocessor post-close hooks at 1675861390482 (+6 ms)Closed at 1675861390482 2023-02-08 13:03:10,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:10,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 29c979748dd245a848d7f00e7e64d7a3, disabling compactions & flushes 2023-02-08 13:03:10,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:10,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:10,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. after waiting 0 ms 2023-02-08 13:03:10,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:10,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:10,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:10,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:10,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 29c979748dd245a848d7f00e7e64d7a3: Waiting for close lock at 1675861390483Running coprocessor pre-close hooks at 1675861390483Disabling compacts and flushes for region at 1675861390483Disabling writes for close at 1675861390483Writing region close event to WAL at 1675861390490 (+7 ms)Running coprocessor post-close hooks at 1675861390501 (+11 ms)Closed at 1675861390502 (+1 ms) 2023-02-08 13:03:10,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:10,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4fab3b755525525a1b3d8c1e9b5f1662, disabling compactions & flushes 2023-02-08 13:03:10,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:10,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:10,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. after waiting 0 ms 2023-02-08 13:03:10,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:10,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:10,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fff00124cd01a9a3f626404ca9571f87: Waiting for close lock at 1675861390481Running coprocessor pre-close hooks at 1675861390481Disabling compacts and flushes for region at 1675861390481Disabling writes for close at 1675861390481Writing region close event to WAL at 1675861390488 (+7 ms)Running coprocessor post-close hooks at 1675861390507 (+19 ms)Closed at 1675861390508 (+1 ms) 2023-02-08 13:03:10,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:10,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cfdb1186af27595316aea7a5b72c2155, disabling compactions & flushes 2023-02-08 13:03:10,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. 2023-02-08 13:03:10,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. 2023-02-08 13:03:10,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. after waiting 0 ms 2023-02-08 13:03:10,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. 2023-02-08 13:03:10,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing cfdb1186af27595316aea7a5b72c2155 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 13:03:10,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4fab3b755525525a1b3d8c1e9b5f1662/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 13:03:10,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:10,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4fab3b755525525a1b3d8c1e9b5f1662: Waiting for close lock at 1675861390502Running coprocessor pre-close hooks at 1675861390502Disabling compacts and flushes for region at 1675861390502Disabling writes for close at 1675861390502Writing region close event to WAL at 1675861390507 (+5 ms)Running coprocessor post-close hooks at 1675861390511 (+4 ms)Closed at 1675861390512 (+1 ms) 2023-02-08 13:03:10,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:10,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4e985e29dd592f319583db6f3f6cf869, disabling compactions & flushes 2023-02-08 13:03:10,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:10,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:10,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. after waiting 0 ms 2023-02-08 13:03:10,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:10,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/4e985e29dd592f319583db6f3f6cf869/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 13:03:10,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:10,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4e985e29dd592f319583db6f3f6cf869: Waiting for close lock at 1675861390512Running coprocessor pre-close hooks at 1675861390512Disabling compacts and flushes for region at 1675861390512Disabling writes for close at 1675861390512Writing region close event to WAL at 1675861390513 (+1 ms)Running coprocessor post-close hooks at 1675861390516 (+3 ms)Closed at 1675861390518 (+2 ms) 2023-02-08 13:03:10,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:10,519 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:10,519 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:10,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/namespace/cfdb1186af27595316aea7a5b72c2155/.tmp/info/ecfd666f86684251aad49333c5ea2ec3 2023-02-08 13:03:10,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/namespace/cfdb1186af27595316aea7a5b72c2155/.tmp/info/ecfd666f86684251aad49333c5ea2ec3 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/namespace/cfdb1186af27595316aea7a5b72c2155/info/ecfd666f86684251aad49333c5ea2ec3 2023-02-08 13:03:10,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/namespace/cfdb1186af27595316aea7a5b72c2155/info/ecfd666f86684251aad49333c5ea2ec3, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 13:03:10,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cfdb1186af27595316aea7a5b72c2155 in 26ms, sequenceid=6, compaction requested=false 2023-02-08 13:03:10,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-08 13:03:10,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/namespace/cfdb1186af27595316aea7a5b72c2155/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 13:03:10,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. 2023-02-08 13:03:10,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cfdb1186af27595316aea7a5b72c2155: Waiting for close lock at 1675861390508Running coprocessor pre-close hooks at 1675861390508Disabling compacts and flushes for region at 1675861390508Disabling writes for close at 1675861390508Obtaining lock to block concurrent updates at 1675861390509 (+1 ms)Preparing flush snapshotting stores in cfdb1186af27595316aea7a5b72c2155 at 1675861390509Finished memstore snapshotting hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675861390509Flushing stores of hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. at 1675861390509Flushing cfdb1186af27595316aea7a5b72c2155/info: creating writer at 1675861390509Flushing cfdb1186af27595316aea7a5b72c2155/info: appending metadata at 1675861390512 (+3 ms)Flushing cfdb1186af27595316aea7a5b72c2155/info: closing flushed file at 1675861390512Flushing cfdb1186af27595316aea7a5b72c2155/info: reopening flushed file at 1675861390527 (+15 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cfdb1186af27595316aea7a5b72c2155 in 26ms, sequenceid=6, compaction requested=false at 1675861390534 (+7 ms)Writing region close event to WAL at 1675861390535 (+1 ms)Running coprocessor post-close hooks at 1675861390539 (+4 ms)Closed at 1675861390539 2023-02-08 13:03:10,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675861385215.cfdb1186af27595316aea7a5b72c2155. 2023-02-08 13:03:10,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 339eb211e42ee5c15cac8e475de59e5d, disabling compactions & flushes 2023-02-08 13:03:10,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:10,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:10,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. after waiting 0 ms 2023-02-08 13:03:10,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:10,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:10,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:10,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 339eb211e42ee5c15cac8e475de59e5d: Waiting for close lock at 1675861390539Running coprocessor pre-close hooks at 1675861390539Disabling compacts and flushes for region at 1675861390539Disabling writes for close at 1675861390539Writing region close event to WAL at 1675861390541 (+2 ms)Running coprocessor post-close hooks at 1675861390544 (+3 ms)Closed at 1675861390545 (+1 ms) 2023-02-08 13:03:10,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:10,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6b402cc95a33009ae614fee264ac5d90, disabling compactions & flushes 2023-02-08 13:03:10,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:10,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:10,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. after waiting 0 ms 2023-02-08 13:03:10,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:10,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:10,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:10,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6b402cc95a33009ae614fee264ac5d90: Waiting for close lock at 1675861390545Running coprocessor pre-close hooks at 1675861390545Disabling compacts and flushes for region at 1675861390545Disabling writes for close at 1675861390545Writing region close event to WAL at 1675861390549 (+4 ms)Running coprocessor post-close hooks at 1675861390553 (+4 ms)Closed at 1675861390553 2023-02-08 13:03:10,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:10,638 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40021,1675861384560; all regions closed. 2023-02-08 13:03:10,640 DEBUG [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 13:03:10,643 DEBUG [RS:1;jenkins-hbase4:40021] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/oldWALs 2023-02-08 13:03:10,643 INFO [RS:1;jenkins-hbase4:40021] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40021%2C1675861384560:(num 1675861385585) 2023-02-08 13:03:10,644 DEBUG [RS:1;jenkins-hbase4:40021] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:10,644 INFO [RS:1;jenkins-hbase4:40021] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:10,644 INFO [RS:1;jenkins-hbase4:40021] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:10,644 INFO [RS:1;jenkins-hbase4:40021] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:10,644 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:10,644 INFO [RS:1;jenkins-hbase4:40021] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:10,644 INFO [RS:1;jenkins-hbase4:40021] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:10,645 INFO [RS:1;jenkins-hbase4:40021] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40021 2023-02-08 13:03:10,648 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,648 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:10,648 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:10,648 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40021,1675861384560 2023-02-08 13:03:10,649 ERROR [Listener at localhost/46349-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4080ee28 rejected from java.util.concurrent.ThreadPoolExecutor@44bf62e0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:10,649 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:10,649 ERROR [Listener at localhost/46349-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7740663d rejected from java.util.concurrent.ThreadPoolExecutor@44bf62e0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:10,650 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40021,1675861384560] 2023-02-08 13:03:10,650 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40021,1675861384560; numProcessing=1 2023-02-08 13:03:10,651 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40021,1675861384560 already deleted, retry=false 2023-02-08 13:03:10,651 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40021,1675861384560 expired; onlineServers=1 2023-02-08 13:03:10,840 DEBUG [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 13:03:10,841 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-08 13:03:10,863 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-08 13:03:10,864 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-08 13:03:10,908 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/.tmp/table/b661d3692dd5406e98de680c5c477895 2023-02-08 13:03:10,913 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/.tmp/info/a28addfc2c0c468da353f3f8767e7208 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/info/a28addfc2c0c468da353f3f8767e7208 2023-02-08 13:03:10,918 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/info/a28addfc2c0c468da353f3f8767e7208, entries=110, sequenceid=32, filesize=18.7 K 2023-02-08 13:03:10,919 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/.tmp/table/b661d3692dd5406e98de680c5c477895 as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/table/b661d3692dd5406e98de680c5c477895 2023-02-08 13:03:10,924 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/table/b661d3692dd5406e98de680c5c477895, entries=4, sequenceid=32, filesize=4.8 K 2023-02-08 13:03:10,925 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 485ms, sequenceid=32, compaction requested=false 2023-02-08 13:03:10,930 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:10,930 INFO [RS:1;jenkins-hbase4:40021] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40021,1675861384560; zookeeper connection closed. 2023-02-08 13:03:10,930 ERROR [Listener at localhost/46349-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@fe1fbcf rejected from java.util.concurrent.ThreadPoolExecutor@44bf62e0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:10,930 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@615bbc50] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@615bbc50 2023-02-08 13:03:10,930 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:40021-0x100340746ad0002, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:10,931 ERROR [Listener at localhost/46349-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1517f8dd rejected from java.util.concurrent.ThreadPoolExecutor@44bf62e0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:10,933 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-08 13:03:10,933 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 13:03:10,934 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:10,934 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861390435Running coprocessor pre-close hooks at 1675861390435Disabling compacts and flushes for region at 1675861390435Disabling writes for close at 1675861390439 (+4 ms)Obtaining lock to block concurrent updates at 1675861390441 (+2 ms)Preparing flush snapshotting stores in 1588230740 at 1675861390441Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1675861390444 (+3 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675861390445 (+1 ms)Flushing 1588230740/info: creating writer at 1675861390445Flushing 1588230740/info: appending metadata at 1675861390448 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675861390448Flushing 1588230740/table: creating writer at 1675861390482 (+34 ms)Flushing 1588230740/table: appending metadata at 1675861390488 (+6 ms)Flushing 1588230740/table: closing flushed file at 1675861390488Flushing 1588230740/info: reopening flushed file at 1675861390914 (+426 ms)Flushing 1588230740/table: reopening flushed file at 1675861390920 (+6 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 485ms, sequenceid=32, compaction requested=false at 1675861390925 (+5 ms)Writing region close event to WAL at 1675861390928 (+3 ms)Running coprocessor post-close hooks at 1675861390933 (+5 ms)Closed at 1675861390934 (+1 ms) 2023-02-08 13:03:10,934 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:11,040 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39709,1675861384522; all regions closed. 2023-02-08 13:03:11,046 DEBUG [RS:0;jenkins-hbase4:39709] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/oldWALs 2023-02-08 13:03:11,046 INFO [RS:0;jenkins-hbase4:39709] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39709%2C1675861384522.meta:.meta(num 1675861385142) 2023-02-08 13:03:11,051 DEBUG [RS:0;jenkins-hbase4:39709] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/oldWALs 2023-02-08 13:03:11,051 INFO [RS:0;jenkins-hbase4:39709] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39709%2C1675861384522:(num 1675861385908) 2023-02-08 13:03:11,051 DEBUG [RS:0;jenkins-hbase4:39709] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:11,051 INFO [RS:0;jenkins-hbase4:39709] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:11,051 INFO [RS:0;jenkins-hbase4:39709] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:11,052 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:11,052 INFO [RS:0;jenkins-hbase4:39709] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39709 2023-02-08 13:03:11,056 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39709,1675861384522 2023-02-08 13:03:11,056 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:11,056 ERROR [Listener at localhost/46349-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@69928d2c rejected from java.util.concurrent.ThreadPoolExecutor@6dad14c6[Shutting down, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:11,057 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39709,1675861384522] 2023-02-08 13:03:11,057 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39709,1675861384522; numProcessing=2 2023-02-08 13:03:11,058 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39709,1675861384522 already deleted, retry=false 2023-02-08 13:03:11,058 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39709,1675861384522 expired; onlineServers=0 2023-02-08 13:03:11,058 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35621,1675861384459' ***** 2023-02-08 13:03:11,058 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 13:03:11,059 DEBUG [M:0;jenkins-hbase4:35621] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@683bf4c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:11,059 INFO [M:0;jenkins-hbase4:35621] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35621,1675861384459 2023-02-08 13:03:11,059 INFO [M:0;jenkins-hbase4:35621] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35621,1675861384459; all regions closed. 2023-02-08 13:03:11,059 DEBUG [M:0;jenkins-hbase4:35621] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:11,059 DEBUG [M:0;jenkins-hbase4:35621] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 13:03:11,059 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 13:03:11,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861384754] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861384754,5,FailOnTimeoutGroup] 2023-02-08 13:03:11,059 DEBUG [M:0;jenkins-hbase4:35621] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 13:03:11,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861384756] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861384756,5,FailOnTimeoutGroup] 2023-02-08 13:03:11,060 INFO [M:0;jenkins-hbase4:35621] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 13:03:11,061 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:11,061 INFO [M:0;jenkins-hbase4:35621] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 13:03:11,061 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:11,061 INFO [M:0;jenkins-hbase4:35621] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 13:03:11,061 DEBUG [M:0;jenkins-hbase4:35621] master.HMaster(1502): Stopping service threads 2023-02-08 13:03:11,061 INFO [M:0;jenkins-hbase4:35621] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 13:03:11,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:11,062 ERROR [M:0;jenkins-hbase4:35621] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-08 13:03:11,062 INFO [M:0;jenkins-hbase4:35621] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 13:03:11,062 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 13:03:11,062 DEBUG [M:0;jenkins-hbase4:35621] zookeeper.ZKUtil(398): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 13:03:11,062 WARN [M:0;jenkins-hbase4:35621] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 13:03:11,062 INFO [M:0;jenkins-hbase4:35621] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 13:03:11,063 INFO [M:0;jenkins-hbase4:35621] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 13:03:11,063 DEBUG [M:0;jenkins-hbase4:35621] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:03:11,063 INFO [M:0;jenkins-hbase4:35621] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:11,063 DEBUG [M:0;jenkins-hbase4:35621] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:11,063 DEBUG [M:0;jenkins-hbase4:35621] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:03:11,063 DEBUG [M:0;jenkins-hbase4:35621] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:11,063 INFO [M:0;jenkins-hbase4:35621] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-08 13:03:11,073 INFO [M:0;jenkins-hbase4:35621] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/266096cb6445424ea62a7549745561ce 2023-02-08 13:03:11,078 DEBUG [M:0;jenkins-hbase4:35621] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/266096cb6445424ea62a7549745561ce as hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/266096cb6445424ea62a7549745561ce 2023-02-08 13:03:11,083 INFO [M:0;jenkins-hbase4:35621] regionserver.HStore(1080): Added hdfs://localhost:34987/user/jenkins/test-data/aa240608-5e32-a2c0-c16d-ea6d48558cc1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/266096cb6445424ea62a7549745561ce, entries=31, sequenceid=218, filesize=9.0 K 2023-02-08 13:03:11,084 INFO [M:0;jenkins-hbase4:35621] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=218, compaction requested=false 2023-02-08 13:03:11,084 INFO [M:0;jenkins-hbase4:35621] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:11,085 DEBUG [M:0;jenkins-hbase4:35621] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861391063Disabling compacts and flushes for region at 1675861391063Disabling writes for close at 1675861391063Obtaining lock to block concurrent updates at 1675861391063Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675861391063Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103362, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1675861391063Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675861391064 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675861391064Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675861391067 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675861391067Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675861391079 (+12 ms)Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=218, compaction requested=false at 1675861391084 (+5 ms)Writing region close event to WAL at 1675861391084Closed at 1675861391084 2023-02-08 13:03:11,088 INFO [M:0;jenkins-hbase4:35621] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 13:03:11,088 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:11,089 INFO [M:0;jenkins-hbase4:35621] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35621 2023-02-08 13:03:11,093 DEBUG [M:0;jenkins-hbase4:35621] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35621,1675861384459 already deleted, retry=false 2023-02-08 13:03:11,158 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:11,158 INFO [RS:0;jenkins-hbase4:39709] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39709,1675861384522; zookeeper connection closed. 2023-02-08 13:03:11,158 ERROR [Listener at localhost/46349-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@64cbf57b rejected from java.util.concurrent.ThreadPoolExecutor@6dad14c6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:11,158 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@fcd559b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@fcd559b 2023-02-08 13:03:11,158 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): regionserver:39709-0x100340746ad0001, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:11,158 ERROR [Listener at localhost/46349-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1cc3c3e8 rejected from java.util.concurrent.ThreadPoolExecutor@6dad14c6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:11,158 INFO [Listener at localhost/46349] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 13:03:11,258 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:11,258 INFO [M:0;jenkins-hbase4:35621] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35621,1675861384459; zookeeper connection closed. 2023-02-08 13:03:11,258 ERROR [Listener at localhost/46349-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@58c530ad rejected from java.util.concurrent.ThreadPoolExecutor@5cfaaf6d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:11,259 DEBUG [Listener at localhost/46349-EventThread] zookeeper.ZKWatcher(600): master:35621-0x100340746ad0000, quorum=127.0.0.1:64909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:11,259 ERROR [Listener at localhost/46349-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@599a2798 rejected from java.util.concurrent.ThreadPoolExecutor@5cfaaf6d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:11,347 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/hadoop-2472800875699343859.jar 2023-02-08 13:03:11,352 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675861387151 type: FLUSH version: 2 ttl: 0 2023-02-08 13:03:11,352 DEBUG [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce 2023-02-08 13:03:11,352 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(239): region to add: 0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:11,352 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(239): region to add: 3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:11,352 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(239): region to add: fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:11,352 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(239): region to add: a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(239): region to add: 86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(239): region to add: 339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(239): region to add: 29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(239): region to add: 4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(239): region to add: 6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(239): region to add: 4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(585): clone region=0f324c53feb5004dc32970d166e42a4a as 0f324c53feb5004dc32970d166e42a4a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(585): clone region=3c61a4344edb4e7db2fd002a7a51fdbb as 3c61a4344edb4e7db2fd002a7a51fdbb in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(585): clone region=fff00124cd01a9a3f626404ca9571f87 as fff00124cd01a9a3f626404ca9571f87 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(585): clone region=a130a58e526c1ec31f1634967d9c6aa4 as a130a58e526c1ec31f1634967d9c6aa4 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(585): clone region=86ea3299ee0b3655463ad474dbd2e36b as 86ea3299ee0b3655463ad474dbd2e36b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(585): clone region=339eb211e42ee5c15cac8e475de59e5d as 339eb211e42ee5c15cac8e475de59e5d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(585): clone region=29c979748dd245a848d7f00e7e64d7a3 as 29c979748dd245a848d7f00e7e64d7a3 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(585): clone region=4fab3b755525525a1b3d8c1e9b5f1662 as 4fab3b755525525a1b3d8c1e9b5f1662 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(585): clone region=6b402cc95a33009ae614fee264ac5d90 as 6b402cc95a33009ae614fee264ac5d90 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:11,353 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(585): clone region=4e985e29dd592f319583db6f3f6cf869 as 4e985e29dd592f319583db6f3f6cf869 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-08 13:03:11,355 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0f324c53feb5004dc32970d166e42a4a, NAME => 'testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412 2023-02-08 13:03:11,355 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => fff00124cd01a9a3f626404ca9571f87, NAME => 'testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412 2023-02-08 13:03:11,355 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 86ea3299ee0b3655463ad474dbd2e36b, NAME => 'testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412 2023-02-08 13:03:11,355 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3c61a4344edb4e7db2fd002a7a51fdbb, NAME => 'testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412 2023-02-08 13:03:11,355 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => a130a58e526c1ec31f1634967d9c6aa4, NAME => 'testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412 2023-02-08 13:03:11,356 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 339eb211e42ee5c15cac8e475de59e5d, NAME => 'testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412 2023-02-08 13:03:11,356 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 29c979748dd245a848d7f00e7e64d7a3, NAME => 'testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412 2023-02-08 13:03:11,357 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 4fab3b755525525a1b3d8c1e9b5f1662, NAME => 'testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412 2023-02-08 13:03:11,384 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,384 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 334a346dadcb4ff09b4351104b6fbb6a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,398 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,398 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ca1355e03fa0462b8e1b5748b359b748 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,404 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,404 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,404 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 4fab3b755525525a1b3d8c1e9b5f1662, disabling compactions & flushes 2023-02-08 13:03:11,404 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink badad35939b34a2c9725b23b971625b9 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,404 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9381fb57791f42be9cd3fbe07593782d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,405 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 719c54cfb2594295a6e9395e2e7ca0b4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,404 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:11,405 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,405 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:11,405 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f35e06abdc664976b7b62bb1910e3b27 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,405 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. after waiting 0 ms 2023-02-08 13:03:11,406 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:11,406 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:11,406 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 4fab3b755525525a1b3d8c1e9b5f1662: Waiting for close lock at 1675861391404Disabling compacts and flushes for region at 1675861391404Disabling writes for close at 1675861391406 (+2 ms)Writing region close event to WAL at 1675861391406Closed at 1675861391406 2023-02-08 13:03:11,406 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 6b402cc95a33009ae614fee264ac5d90, NAME => 'testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412 2023-02-08 13:03:11,408 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,408 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,408 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,408 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fccc50ebcb314f10a4d5f6648b42d506 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,408 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1612d3ec613f49e48f78db5cc174395b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,409 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a89e740c0eb8466fbba058a061cb3845 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,414 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 3c61a4344edb4e7db2fd002a7a51fdbb, disabling compactions & flushes 2023-02-08 13:03:11,414 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:11,414 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:11,414 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. after waiting 0 ms 2023-02-08 13:03:11,414 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:11,414 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:11,414 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 3c61a4344edb4e7db2fd002a7a51fdbb: Waiting for close lock at 1675861391414Disabling compacts and flushes for region at 1675861391414Disabling writes for close at 1675861391414Writing region close event to WAL at 1675861391414Closed at 1675861391414 2023-02-08 13:03:11,414 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4e985e29dd592f319583db6f3f6cf869, NAME => 'testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412 2023-02-08 13:03:11,417 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing a130a58e526c1ec31f1634967d9c6aa4, disabling compactions & flushes 2023-02-08 13:03:11,417 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:11,417 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:11,417 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. after waiting 0 ms 2023-02-08 13:03:11,417 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:11,417 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:11,417 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for a130a58e526c1ec31f1634967d9c6aa4: Waiting for close lock at 1675861391417Disabling compacts and flushes for region at 1675861391417Disabling writes for close at 1675861391417Writing region close event to WAL at 1675861391417Closed at 1675861391417 2023-02-08 13:03:11,417 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7f74ff48586947148fd2a3cb09a43f3f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,417 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink de28bf4f4b784e5081e2a713b0a08772 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,417 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b8637ffc828b4a2189edf8601d1e194f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,420 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5093633174924f4e9bc85ac344548377 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,420 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9411de22e6924c8eacda512a5ec4f59a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,421 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 0f324c53feb5004dc32970d166e42a4a, disabling compactions & flushes 2023-02-08 13:03:11,422 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:11,422 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:11,422 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. after waiting 0 ms 2023-02-08 13:03:11,422 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:11,422 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:11,422 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 0f324c53feb5004dc32970d166e42a4a: Waiting for close lock at 1675861391421Disabling compacts and flushes for region at 1675861391421Disabling writes for close at 1675861391422 (+1 ms)Writing region close event to WAL at 1675861391422Closed at 1675861391422 2023-02-08 13:03:11,425 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 339eb211e42ee5c15cac8e475de59e5d, disabling compactions & flushes 2023-02-08 13:03:11,425 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:11,425 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 86ea3299ee0b3655463ad474dbd2e36b, disabling compactions & flushes 2023-02-08 13:03:11,425 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:11,425 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:11,425 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. after waiting 0 ms 2023-02-08 13:03:11,425 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:11,425 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:11,425 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:11,426 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. after waiting 0 ms 2023-02-08 13:03:11,426 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 339eb211e42ee5c15cac8e475de59e5d: Waiting for close lock at 1675861391425Disabling compacts and flushes for region at 1675861391425Disabling writes for close at 1675861391425Writing region close event to WAL at 1675861391425Closed at 1675861391425 2023-02-08 13:03:11,426 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing fff00124cd01a9a3f626404ca9571f87, disabling compactions & flushes 2023-02-08 13:03:11,426 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:11,426 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:11,426 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:11,426 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:11,426 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. after waiting 0 ms 2023-02-08 13:03:11,426 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 86ea3299ee0b3655463ad474dbd2e36b: Waiting for close lock at 1675861391425Disabling compacts and flushes for region at 1675861391425Disabling writes for close at 1675861391426 (+1 ms)Writing region close event to WAL at 1675861391426Closed at 1675861391426 2023-02-08 13:03:11,426 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 29c979748dd245a848d7f00e7e64d7a3, disabling compactions & flushes 2023-02-08 13:03:11,426 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:11,426 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:11,426 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:11,426 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:11,426 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for fff00124cd01a9a3f626404ca9571f87: Waiting for close lock at 1675861391426Disabling compacts and flushes for region at 1675861391426Disabling writes for close at 1675861391426Writing region close event to WAL at 1675861391426Closed at 1675861391426 2023-02-08 13:03:11,426 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. after waiting 0 ms 2023-02-08 13:03:11,426 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:11,427 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:11,427 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 29c979748dd245a848d7f00e7e64d7a3: Waiting for close lock at 1675861391426Disabling compacts and flushes for region at 1675861391426Disabling writes for close at 1675861391426Writing region close event to WAL at 1675861391427 (+1 ms)Closed at 1675861391427 2023-02-08 13:03:11,428 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,428 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f6c0bc174ad3496582b65229322fd695 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,429 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,430 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 4e985e29dd592f319583db6f3f6cf869, disabling compactions & flushes 2023-02-08 13:03:11,430 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:11,430 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:11,430 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. after waiting 0 ms 2023-02-08 13:03:11,430 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:11,430 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:11,430 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 4e985e29dd592f319583db6f3f6cf869: Waiting for close lock at 1675861391430Disabling compacts and flushes for region at 1675861391430Disabling writes for close at 1675861391430Writing region close event to WAL at 1675861391430Closed at 1675861391430 2023-02-08 13:03:11,430 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e6fff3008cd84e5aabe5edb04cc568bf from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-08 13:03:11,432 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 6b402cc95a33009ae614fee264ac5d90, disabling compactions & flushes 2023-02-08 13:03:11,432 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:11,432 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:11,432 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. after waiting 0 ms 2023-02-08 13:03:11,432 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:11,432 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:11,432 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 6b402cc95a33009ae614fee264ac5d90: Waiting for close lock at 1675861391432Disabling compacts and flushes for region at 1675861391432Disabling writes for close at 1675861391432Writing region close event to WAL at 1675861391432Closed at 1675861391432 2023-02-08 13:03:11,433 INFO [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675861387151 type: FLUSH version: 2 ttl: 0 2023-02-08 13:03:11,433 DEBUG [Listener at localhost/46349] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412 2023-02-08 13:03:11,433 DEBUG [Listener at localhost/46349] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412 2023-02-08 13:03:11,433 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-data/ 2023-02-08 13:03:11,434 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |----default/ 2023-02-08 13:03:11,434 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-08 13:03:11,435 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |----------0f324c53feb5004dc32970d166e42a4a/ 2023-02-08 13:03:11,435 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:11,435 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:11,436 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=0f324c53feb5004dc32970d166e42a4a-f35e06abdc664976b7b62bb1910e3b27 2023-02-08 13:03:11,436 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:11,436 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=0f324c53feb5004dc32970d166e42a4a-b8637ffc828b4a2189edf8601d1e194f 2023-02-08 13:03:11,436 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |----------29c979748dd245a848d7f00e7e64d7a3/ 2023-02-08 13:03:11,437 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:11,437 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:11,437 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=29c979748dd245a848d7f00e7e64d7a3-a89e740c0eb8466fbba058a061cb3845 2023-02-08 13:03:11,437 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:11,438 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=29c979748dd245a848d7f00e7e64d7a3-5093633174924f4e9bc85ac344548377 2023-02-08 13:03:11,438 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |----------339eb211e42ee5c15cac8e475de59e5d/ 2023-02-08 13:03:11,438 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:11,438 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:11,438 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=339eb211e42ee5c15cac8e475de59e5d-fccc50ebcb314f10a4d5f6648b42d506 2023-02-08 13:03:11,439 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:11,439 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=339eb211e42ee5c15cac8e475de59e5d-de28bf4f4b784e5081e2a713b0a08772 2023-02-08 13:03:11,439 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |----------3c61a4344edb4e7db2fd002a7a51fdbb/ 2023-02-08 13:03:11,439 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:11,439 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:11,440 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=3c61a4344edb4e7db2fd002a7a51fdbb-ca1355e03fa0462b8e1b5748b359b748 2023-02-08 13:03:11,440 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:11,440 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=3c61a4344edb4e7db2fd002a7a51fdbb-719c54cfb2594295a6e9395e2e7ca0b4 2023-02-08 13:03:11,440 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |----------4e985e29dd592f319583db6f3f6cf869/ 2023-02-08 13:03:11,441 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:11,441 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |----------4fab3b755525525a1b3d8c1e9b5f1662/ 2023-02-08 13:03:11,441 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:11,441 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |----------6b402cc95a33009ae614fee264ac5d90/ 2023-02-08 13:03:11,442 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:11,442 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:11,442 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=6b402cc95a33009ae614fee264ac5d90-f6c0bc174ad3496582b65229322fd695 2023-02-08 13:03:11,442 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:11,443 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=6b402cc95a33009ae614fee264ac5d90-e6fff3008cd84e5aabe5edb04cc568bf 2023-02-08 13:03:11,443 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |----------86ea3299ee0b3655463ad474dbd2e36b/ 2023-02-08 13:03:11,443 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:11,443 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:11,444 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=86ea3299ee0b3655463ad474dbd2e36b-1612d3ec613f49e48f78db5cc174395b 2023-02-08 13:03:11,444 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:11,444 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=86ea3299ee0b3655463ad474dbd2e36b-7f74ff48586947148fd2a3cb09a43f3f 2023-02-08 13:03:11,444 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |----------a130a58e526c1ec31f1634967d9c6aa4/ 2023-02-08 13:03:11,445 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:11,445 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:11,445 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=a130a58e526c1ec31f1634967d9c6aa4-334a346dadcb4ff09b4351104b6fbb6a 2023-02-08 13:03:11,445 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:11,445 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=a130a58e526c1ec31f1634967d9c6aa4-9381fb57791f42be9cd3fbe07593782d 2023-02-08 13:03:11,445 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |----------fff00124cd01a9a3f626404ca9571f87/ 2023-02-08 13:03:11,446 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:11,446 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:11,446 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=fff00124cd01a9a3f626404ca9571f87-badad35939b34a2c9725b23b971625b9 2023-02-08 13:03:11,446 DEBUG [Listener at localhost/46349] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:11,447 DEBUG [Listener at localhost/46349] util.CommonFSUtils(702): |----------------testWithMapReduce=fff00124cd01a9a3f626404ca9571f87-9411de22e6924c8eacda512a5ec4f59a 2023-02-08 13:03:11,447 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,447 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,448 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,448 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,449 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,449 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,449 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,515 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/hadoop-5376319550431411577.jar 2023-02-08 13:03:11,515 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,516 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,516 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,516 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,517 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,517 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,517 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-08 13:03:11,518 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-08 13:03:11,518 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-08 13:03:11,519 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-08 13:03:11,519 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-08 13:03:11,520 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-08 13:03:11,521 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-08 13:03:11,521 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-08 13:03:11,522 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-08 13:03:11,522 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-08 13:03:11,523 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:11,524 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 13:03:11,524 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 13:03:11,525 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 13:03:11,525 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-08 13:03:11,593 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/hadoop-274041387986522358.jar 2023-02-08 13:03:11,593 DEBUG [Listener at localhost/46349] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-08 13:03:11,598 WARN [Listener at localhost/46349] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-08 13:03:11,628 INFO [Listener at localhost/46349] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-08 13:03:11,730 WARN [Listener at localhost/46349] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/mapreduce.cluster.local.dir/1675861391699/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-08 13:03:11,730 WARN [Listener at localhost/46349] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/mapreduce.cluster.local.dir/1675861391699/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-08 13:03:11,764 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,764 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:11,765 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:11,767 INFO [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:11,768 DEBUG [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f1 2023-02-08 13:03:11,768 INFO [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f324c53feb5004dc32970d166e42a4a columnFamilyName f1 2023-02-08 13:03:11,773 DEBUG [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f1/testWithMapReduce=0f324c53feb5004dc32970d166e42a4a-f35e06abdc664976b7b62bb1910e3b27 2023-02-08 13:03:11,774 INFO [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] regionserver.HStore(310): Store=0f324c53feb5004dc32970d166e42a4a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:11,774 INFO [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0f324c53feb5004dc32970d166e42a4a 2023-02-08 13:03:11,775 DEBUG [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f2 2023-02-08 13:03:11,775 INFO [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f324c53feb5004dc32970d166e42a4a columnFamilyName f2 2023-02-08 13:03:11,780 DEBUG [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/0f324c53feb5004dc32970d166e42a4a/f2/testWithMapReduce=0f324c53feb5004dc32970d166e42a4a-b8637ffc828b4a2189edf8601d1e194f 2023-02-08 13:03:11,780 INFO [StoreOpener-0f324c53feb5004dc32970d166e42a4a-1] regionserver.HStore(310): Store=0f324c53feb5004dc32970d166e42a4a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:11,780 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:11,780 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0f324c53feb5004dc32970d166e42a4a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61981613, jitterRate=-0.07640199363231659}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:11,780 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0f324c53feb5004dc32970d166e42a4a: Writing region info on filesystem at 1675861391765Initializing all the Stores at 1675861391766 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861391766Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861391766Region opened successfully at 1675861391780 (+14 ms) 2023-02-08 13:03:11,811 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0f324c53feb5004dc32970d166e42a4a, disabling compactions & flushes 2023-02-08 13:03:11,811 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:11,811 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:11,811 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. after waiting 0 ms 2023-02-08 13:03:11,811 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:11,812 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675861385813.0f324c53feb5004dc32970d166e42a4a. 2023-02-08 13:03:11,812 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0f324c53feb5004dc32970d166e42a4a: Waiting for close lock at 1675861391811Disabling compacts and flushes for region at 1675861391811Disabling writes for close at 1675861391811Writing region close event to WAL at 1675861391812 (+1 ms)Closed at 1675861391812 2023-02-08 13:03:11,815 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,815 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:11,817 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:11,819 INFO [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:11,820 DEBUG [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f1 2023-02-08 13:03:11,820 INFO [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c61a4344edb4e7db2fd002a7a51fdbb columnFamilyName f1 2023-02-08 13:03:11,825 DEBUG [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f1/testWithMapReduce=3c61a4344edb4e7db2fd002a7a51fdbb-ca1355e03fa0462b8e1b5748b359b748 2023-02-08 13:03:11,825 INFO [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] regionserver.HStore(310): Store=3c61a4344edb4e7db2fd002a7a51fdbb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:11,825 INFO [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3c61a4344edb4e7db2fd002a7a51fdbb 2023-02-08 13:03:11,826 DEBUG [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f2 2023-02-08 13:03:11,826 INFO [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c61a4344edb4e7db2fd002a7a51fdbb columnFamilyName f2 2023-02-08 13:03:11,831 DEBUG [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/3c61a4344edb4e7db2fd002a7a51fdbb/f2/testWithMapReduce=3c61a4344edb4e7db2fd002a7a51fdbb-719c54cfb2594295a6e9395e2e7ca0b4 2023-02-08 13:03:11,831 INFO [StoreOpener-3c61a4344edb4e7db2fd002a7a51fdbb-1] regionserver.HStore(310): Store=3c61a4344edb4e7db2fd002a7a51fdbb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:11,831 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:11,831 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3c61a4344edb4e7db2fd002a7a51fdbb; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73508812, jitterRate=0.09536665678024292}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:11,831 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3c61a4344edb4e7db2fd002a7a51fdbb: Writing region info on filesystem at 1675861391817Initializing all the Stores at 1675861391818 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861391818Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861391818Region opened successfully at 1675861391831 (+13 ms) 2023-02-08 13:03:11,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3c61a4344edb4e7db2fd002a7a51fdbb, disabling compactions & flushes 2023-02-08 13:03:11,862 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:11,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:11,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. after waiting 0 ms 2023-02-08 13:03:11,863 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:11,863 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675861385813.3c61a4344edb4e7db2fd002a7a51fdbb. 2023-02-08 13:03:11,864 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3c61a4344edb4e7db2fd002a7a51fdbb: Waiting for close lock at 1675861391862Disabling compacts and flushes for region at 1675861391862Disabling writes for close at 1675861391863 (+1 ms)Writing region close event to WAL at 1675861391863Closed at 1675861391863 2023-02-08 13:03:11,868 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,868 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:11,873 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:11,875 INFO [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:11,876 DEBUG [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f1 2023-02-08 13:03:11,876 INFO [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a130a58e526c1ec31f1634967d9c6aa4 columnFamilyName f1 2023-02-08 13:03:11,881 DEBUG [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f1/testWithMapReduce=a130a58e526c1ec31f1634967d9c6aa4-334a346dadcb4ff09b4351104b6fbb6a 2023-02-08 13:03:11,881 INFO [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] regionserver.HStore(310): Store=a130a58e526c1ec31f1634967d9c6aa4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:11,881 INFO [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a130a58e526c1ec31f1634967d9c6aa4 2023-02-08 13:03:11,882 DEBUG [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f2 2023-02-08 13:03:11,882 INFO [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a130a58e526c1ec31f1634967d9c6aa4 columnFamilyName f2 2023-02-08 13:03:11,886 DEBUG [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/a130a58e526c1ec31f1634967d9c6aa4/f2/testWithMapReduce=a130a58e526c1ec31f1634967d9c6aa4-9381fb57791f42be9cd3fbe07593782d 2023-02-08 13:03:11,887 INFO [StoreOpener-a130a58e526c1ec31f1634967d9c6aa4-1] regionserver.HStore(310): Store=a130a58e526c1ec31f1634967d9c6aa4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:11,887 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:11,887 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a130a58e526c1ec31f1634967d9c6aa4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62422820, jitterRate=-0.06982749700546265}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:11,887 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a130a58e526c1ec31f1634967d9c6aa4: Writing region info on filesystem at 1675861391873Initializing all the Stores at 1675861391874 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861391874Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861391874Region opened successfully at 1675861391887 (+13 ms) 2023-02-08 13:03:11,925 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a130a58e526c1ec31f1634967d9c6aa4, disabling compactions & flushes 2023-02-08 13:03:11,925 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:11,925 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:11,926 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. after waiting 0 ms 2023-02-08 13:03:11,926 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:11,927 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675861385813.a130a58e526c1ec31f1634967d9c6aa4. 2023-02-08 13:03:11,927 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a130a58e526c1ec31f1634967d9c6aa4: Waiting for close lock at 1675861391925Disabling compacts and flushes for region at 1675861391925Disabling writes for close at 1675861391926 (+1 ms)Writing region close event to WAL at 1675861391927 (+1 ms)Closed at 1675861391927 2023-02-08 13:03:11,930 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,931 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:11,932 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:11,934 INFO [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:11,935 DEBUG [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f1 2023-02-08 13:03:11,935 INFO [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29c979748dd245a848d7f00e7e64d7a3 columnFamilyName f1 2023-02-08 13:03:11,943 DEBUG [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f1/testWithMapReduce=29c979748dd245a848d7f00e7e64d7a3-a89e740c0eb8466fbba058a061cb3845 2023-02-08 13:03:11,943 INFO [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] regionserver.HStore(310): Store=29c979748dd245a848d7f00e7e64d7a3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:11,943 INFO [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 29c979748dd245a848d7f00e7e64d7a3 2023-02-08 13:03:11,944 DEBUG [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f2 2023-02-08 13:03:11,945 INFO [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29c979748dd245a848d7f00e7e64d7a3 columnFamilyName f2 2023-02-08 13:03:11,949 DEBUG [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/29c979748dd245a848d7f00e7e64d7a3/f2/testWithMapReduce=29c979748dd245a848d7f00e7e64d7a3-5093633174924f4e9bc85ac344548377 2023-02-08 13:03:11,949 INFO [StoreOpener-29c979748dd245a848d7f00e7e64d7a3-1] regionserver.HStore(310): Store=29c979748dd245a848d7f00e7e64d7a3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:11,949 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:11,949 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 29c979748dd245a848d7f00e7e64d7a3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62783685, jitterRate=-0.06445018947124481}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:11,949 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 29c979748dd245a848d7f00e7e64d7a3: Writing region info on filesystem at 1675861391932Initializing all the Stores at 1675861391933 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861391933Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861391933Region opened successfully at 1675861391949 (+16 ms) 2023-02-08 13:03:11,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 29c979748dd245a848d7f00e7e64d7a3, disabling compactions & flushes 2023-02-08 13:03:11,977 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:11,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:11,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. after waiting 0 ms 2023-02-08 13:03:11,977 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:11,978 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675861385813.29c979748dd245a848d7f00e7e64d7a3. 2023-02-08 13:03:11,978 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 29c979748dd245a848d7f00e7e64d7a3: Waiting for close lock at 1675861391976Disabling compacts and flushes for region at 1675861391976Disabling writes for close at 1675861391977 (+1 ms)Writing region close event to WAL at 1675861391978 (+1 ms)Closed at 1675861391978 2023-02-08 13:03:11,981 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:11,981 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:11,982 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:11,984 INFO [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:11,985 DEBUG [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/4fab3b755525525a1b3d8c1e9b5f1662/f1 2023-02-08 13:03:11,986 INFO [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fab3b755525525a1b3d8c1e9b5f1662 columnFamilyName f1 2023-02-08 13:03:11,986 INFO [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] regionserver.HStore(310): Store=4fab3b755525525a1b3d8c1e9b5f1662/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:11,986 INFO [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fab3b755525525a1b3d8c1e9b5f1662 2023-02-08 13:03:11,987 DEBUG [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/4fab3b755525525a1b3d8c1e9b5f1662/f2 2023-02-08 13:03:11,988 INFO [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fab3b755525525a1b3d8c1e9b5f1662 columnFamilyName f2 2023-02-08 13:03:11,988 INFO [StoreOpener-4fab3b755525525a1b3d8c1e9b5f1662-1] regionserver.HStore(310): Store=4fab3b755525525a1b3d8c1e9b5f1662/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:11,988 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:11,989 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4fab3b755525525a1b3d8c1e9b5f1662; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71539520, jitterRate=0.06602191925048828}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:11,989 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4fab3b755525525a1b3d8c1e9b5f1662: Writing region info on filesystem at 1675861391982Initializing all the Stores at 1675861391983 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861391983Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861391983Region opened successfully at 1675861391989 (+6 ms) 2023-02-08 13:03:12,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4fab3b755525525a1b3d8c1e9b5f1662, disabling compactions & flushes 2023-02-08 13:03:12,005 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:12,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:12,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. after waiting 0 ms 2023-02-08 13:03:12,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:12,006 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675861385813.4fab3b755525525a1b3d8c1e9b5f1662. 2023-02-08 13:03:12,006 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4fab3b755525525a1b3d8c1e9b5f1662: Waiting for close lock at 1675861392005Disabling compacts and flushes for region at 1675861392005Disabling writes for close at 1675861392005Writing region close event to WAL at 1675861392006 (+1 ms)Closed at 1675861392006 2023-02-08 13:03:12,009 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:12,009 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:12,011 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:12,013 INFO [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:12,014 DEBUG [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f1 2023-02-08 13:03:12,014 INFO [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 339eb211e42ee5c15cac8e475de59e5d columnFamilyName f1 2023-02-08 13:03:12,019 DEBUG [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f1/testWithMapReduce=339eb211e42ee5c15cac8e475de59e5d-fccc50ebcb314f10a4d5f6648b42d506 2023-02-08 13:03:12,019 INFO [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] regionserver.HStore(310): Store=339eb211e42ee5c15cac8e475de59e5d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:12,019 INFO [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 339eb211e42ee5c15cac8e475de59e5d 2023-02-08 13:03:12,020 DEBUG [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f2 2023-02-08 13:03:12,020 INFO [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 339eb211e42ee5c15cac8e475de59e5d columnFamilyName f2 2023-02-08 13:03:12,025 DEBUG [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/339eb211e42ee5c15cac8e475de59e5d/f2/testWithMapReduce=339eb211e42ee5c15cac8e475de59e5d-de28bf4f4b784e5081e2a713b0a08772 2023-02-08 13:03:12,025 INFO [StoreOpener-339eb211e42ee5c15cac8e475de59e5d-1] regionserver.HStore(310): Store=339eb211e42ee5c15cac8e475de59e5d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:12,025 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:12,025 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 339eb211e42ee5c15cac8e475de59e5d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68911288, jitterRate=0.026858210563659668}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:12,025 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 339eb211e42ee5c15cac8e475de59e5d: Writing region info on filesystem at 1675861392011Initializing all the Stores at 1675861392012 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861392012Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861392012Region opened successfully at 1675861392025 (+13 ms) 2023-02-08 13:03:12,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 339eb211e42ee5c15cac8e475de59e5d, disabling compactions & flushes 2023-02-08 13:03:12,053 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:12,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:12,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. after waiting 0 ms 2023-02-08 13:03:12,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:12,054 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675861385813.339eb211e42ee5c15cac8e475de59e5d. 2023-02-08 13:03:12,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 339eb211e42ee5c15cac8e475de59e5d: Waiting for close lock at 1675861392053Disabling compacts and flushes for region at 1675861392053Disabling writes for close at 1675861392053Writing region close event to WAL at 1675861392054 (+1 ms)Closed at 1675861392054 2023-02-08 13:03:12,057 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:12,057 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:12,058 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:12,060 INFO [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:12,061 DEBUG [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f1 2023-02-08 13:03:12,061 INFO [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b402cc95a33009ae614fee264ac5d90 columnFamilyName f1 2023-02-08 13:03:12,066 DEBUG [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f1/testWithMapReduce=6b402cc95a33009ae614fee264ac5d90-f6c0bc174ad3496582b65229322fd695 2023-02-08 13:03:12,066 INFO [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] regionserver.HStore(310): Store=6b402cc95a33009ae614fee264ac5d90/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:12,066 INFO [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6b402cc95a33009ae614fee264ac5d90 2023-02-08 13:03:12,067 DEBUG [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f2 2023-02-08 13:03:12,067 INFO [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b402cc95a33009ae614fee264ac5d90 columnFamilyName f2 2023-02-08 13:03:12,071 DEBUG [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/6b402cc95a33009ae614fee264ac5d90/f2/testWithMapReduce=6b402cc95a33009ae614fee264ac5d90-e6fff3008cd84e5aabe5edb04cc568bf 2023-02-08 13:03:12,071 INFO [StoreOpener-6b402cc95a33009ae614fee264ac5d90-1] regionserver.HStore(310): Store=6b402cc95a33009ae614fee264ac5d90/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:12,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:12,072 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6b402cc95a33009ae614fee264ac5d90; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62516446, jitterRate=-0.06843236088752747}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:12,072 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6b402cc95a33009ae614fee264ac5d90: Writing region info on filesystem at 1675861392058Initializing all the Stores at 1675861392059 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861392059Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861392059Region opened successfully at 1675861392072 (+13 ms) 2023-02-08 13:03:12,109 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6b402cc95a33009ae614fee264ac5d90, disabling compactions & flushes 2023-02-08 13:03:12,109 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:12,109 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:12,109 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. after waiting 0 ms 2023-02-08 13:03:12,110 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:12,111 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675861385813.6b402cc95a33009ae614fee264ac5d90. 2023-02-08 13:03:12,111 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6b402cc95a33009ae614fee264ac5d90: Waiting for close lock at 1675861392109Disabling compacts and flushes for region at 1675861392109Disabling writes for close at 1675861392110 (+1 ms)Writing region close event to WAL at 1675861392111 (+1 ms)Closed at 1675861392111 2023-02-08 13:03:12,114 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:12,114 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:12,116 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:12,117 INFO [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:12,118 DEBUG [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f1 2023-02-08 13:03:12,119 INFO [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86ea3299ee0b3655463ad474dbd2e36b columnFamilyName f1 2023-02-08 13:03:12,123 DEBUG [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f1/testWithMapReduce=86ea3299ee0b3655463ad474dbd2e36b-1612d3ec613f49e48f78db5cc174395b 2023-02-08 13:03:12,124 INFO [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] regionserver.HStore(310): Store=86ea3299ee0b3655463ad474dbd2e36b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:12,124 INFO [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 86ea3299ee0b3655463ad474dbd2e36b 2023-02-08 13:03:12,125 DEBUG [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f2 2023-02-08 13:03:12,125 INFO [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86ea3299ee0b3655463ad474dbd2e36b columnFamilyName f2 2023-02-08 13:03:12,129 DEBUG [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/86ea3299ee0b3655463ad474dbd2e36b/f2/testWithMapReduce=86ea3299ee0b3655463ad474dbd2e36b-7f74ff48586947148fd2a3cb09a43f3f 2023-02-08 13:03:12,130 INFO [StoreOpener-86ea3299ee0b3655463ad474dbd2e36b-1] regionserver.HStore(310): Store=86ea3299ee0b3655463ad474dbd2e36b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:12,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:12,130 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 86ea3299ee0b3655463ad474dbd2e36b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72604882, jitterRate=0.08189705014228821}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:12,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 86ea3299ee0b3655463ad474dbd2e36b: Writing region info on filesystem at 1675861392116Initializing all the Stores at 1675861392117 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861392117Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861392117Region opened successfully at 1675861392130 (+13 ms) 2023-02-08 13:03:12,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 86ea3299ee0b3655463ad474dbd2e36b, disabling compactions & flushes 2023-02-08 13:03:12,157 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:12,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:12,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. after waiting 0 ms 2023-02-08 13:03:12,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:12,158 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675861385813.86ea3299ee0b3655463ad474dbd2e36b. 2023-02-08 13:03:12,158 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 86ea3299ee0b3655463ad474dbd2e36b: Waiting for close lock at 1675861392157Disabling compacts and flushes for region at 1675861392157Disabling writes for close at 1675861392157Writing region close event to WAL at 1675861392158 (+1 ms)Closed at 1675861392158 2023-02-08 13:03:12,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:12,161 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:12,162 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:12,163 INFO [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:12,165 DEBUG [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/4e985e29dd592f319583db6f3f6cf869/f1 2023-02-08 13:03:12,165 INFO [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e985e29dd592f319583db6f3f6cf869 columnFamilyName f1 2023-02-08 13:03:12,166 INFO [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] regionserver.HStore(310): Store=4e985e29dd592f319583db6f3f6cf869/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:12,166 INFO [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4e985e29dd592f319583db6f3f6cf869 2023-02-08 13:03:12,167 DEBUG [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/4e985e29dd592f319583db6f3f6cf869/f2 2023-02-08 13:03:12,167 INFO [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e985e29dd592f319583db6f3f6cf869 columnFamilyName f2 2023-02-08 13:03:12,168 INFO [StoreOpener-4e985e29dd592f319583db6f3f6cf869-1] regionserver.HStore(310): Store=4e985e29dd592f319583db6f3f6cf869/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:12,168 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:12,168 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4e985e29dd592f319583db6f3f6cf869; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68870895, jitterRate=0.02625630795955658}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:12,168 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4e985e29dd592f319583db6f3f6cf869: Writing region info on filesystem at 1675861392162Initializing all the Stores at 1675861392163 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861392163Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861392163Region opened successfully at 1675861392168 (+5 ms) 2023-02-08 13:03:12,185 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4e985e29dd592f319583db6f3f6cf869, disabling compactions & flushes 2023-02-08 13:03:12,186 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:12,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:12,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. after waiting 0 ms 2023-02-08 13:03:12,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:12,186 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675861385813.4e985e29dd592f319583db6f3f6cf869. 2023-02-08 13:03:12,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4e985e29dd592f319583db6f3f6cf869: Waiting for close lock at 1675861392185Disabling compacts and flushes for region at 1675861392185Disabling writes for close at 1675861392186 (+1 ms)Writing region close event to WAL at 1675861392186Closed at 1675861392186 2023-02-08 13:03:12,190 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:12,190 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:12,191 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:12,193 INFO [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:12,194 DEBUG [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f1 2023-02-08 13:03:12,195 INFO [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fff00124cd01a9a3f626404ca9571f87 columnFamilyName f1 2023-02-08 13:03:12,199 DEBUG [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f1/testWithMapReduce=fff00124cd01a9a3f626404ca9571f87-badad35939b34a2c9725b23b971625b9 2023-02-08 13:03:12,200 INFO [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] regionserver.HStore(310): Store=fff00124cd01a9a3f626404ca9571f87/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:12,200 INFO [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fff00124cd01a9a3f626404ca9571f87 2023-02-08 13:03:12,201 DEBUG [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f2 2023-02-08 13:03:12,201 INFO [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fff00124cd01a9a3f626404ca9571f87 columnFamilyName f2 2023-02-08 13:03:12,212 DEBUG [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] regionserver.HStore(539): loaded hdfs://localhost:34987/user/jenkins/test-data/7e90bfb0-1df2-cbbd-3d43-bdc82c3491c5/testWithMapReduceAndOfflineHBaseMultiRegion/e69cab7b-df43-42a5-beb0-62c64f8c0412/data/default/testWithMapReduce/fff00124cd01a9a3f626404ca9571f87/f2/testWithMapReduce=fff00124cd01a9a3f626404ca9571f87-9411de22e6924c8eacda512a5ec4f59a 2023-02-08 13:03:12,212 INFO [StoreOpener-fff00124cd01a9a3f626404ca9571f87-1] regionserver.HStore(310): Store=fff00124cd01a9a3f626404ca9571f87/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:12,212 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:12,213 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fff00124cd01a9a3f626404ca9571f87; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61490004, jitterRate=-0.08372753858566284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:12,213 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fff00124cd01a9a3f626404ca9571f87: Writing region info on filesystem at 1675861392191Initializing all the Stores at 1675861392192 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861392192Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861392192Region opened successfully at 1675861392213 (+21 ms) 2023-02-08 13:03:12,243 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fff00124cd01a9a3f626404ca9571f87, disabling compactions & flushes 2023-02-08 13:03:12,243 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:12,243 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:12,243 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. after waiting 0 ms 2023-02-08 13:03:12,243 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:12,244 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675861385813.fff00124cd01a9a3f626404ca9571f87. 2023-02-08 13:03:12,244 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fff00124cd01a9a3f626404ca9571f87: Waiting for close lock at 1675861392243Disabling compacts and flushes for region at 1675861392243Disabling writes for close at 1675861392243Writing region close event to WAL at 1675861392244 (+1 ms)Closed at 1675861392244 2023-02-08 13:03:12,764 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 13:03:12,765 WARN [Listener at localhost/46349] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:12,768 INFO [Listener at localhost/46349] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:12,872 WARN [BP-1142115354-172.31.14.131-1675861383850 heartbeating to localhost/127.0.0.1:34987] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:12,872 WARN [BP-1142115354-172.31.14.131-1675861383850 heartbeating to localhost/127.0.0.1:34987] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1142115354-172.31.14.131-1675861383850 (Datanode Uuid 2692c8e0-80bd-47c6-9815-fe6439d4d5b1) service to localhost/127.0.0.1:34987 2023-02-08 13:03:12,873 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/cluster_87cc019f-226f-1138-9403-7c439ac87f49/dfs/data/data3/current/BP-1142115354-172.31.14.131-1675861383850] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:12,873 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/cluster_87cc019f-226f-1138-9403-7c439ac87f49/dfs/data/data4/current/BP-1142115354-172.31.14.131-1675861383850] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:12,874 WARN [Listener at localhost/46349] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:12,877 INFO [Listener at localhost/46349] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:12,981 WARN [BP-1142115354-172.31.14.131-1675861383850 heartbeating to localhost/127.0.0.1:34987] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:12,981 WARN [BP-1142115354-172.31.14.131-1675861383850 heartbeating to localhost/127.0.0.1:34987] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1142115354-172.31.14.131-1675861383850 (Datanode Uuid a2b4b595-877d-4235-872c-ee332af7f002) service to localhost/127.0.0.1:34987 2023-02-08 13:03:12,982 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/cluster_87cc019f-226f-1138-9403-7c439ac87f49/dfs/data/data1/current/BP-1142115354-172.31.14.131-1675861383850] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:12,982 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/cluster_87cc019f-226f-1138-9403-7c439ac87f49/dfs/data/data2/current/BP-1142115354-172.31.14.131-1675861383850] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:12,992 INFO [Listener at localhost/46349] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:13,113 INFO [Listener at localhost/46349] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 13:03:13,154 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 13:03:13,167 INFO [Listener at localhost/46349] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=155 (was 103) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:34987 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34987 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34987 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46349 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34987 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34987 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35621,1675861384459)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34987 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:34987 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=534 (was 544), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=329 (was 313) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 203), AvailableMemoryMB=4108 (was 4221) 2023-02-08 13:03:13,177 INFO [Listener at localhost/46349] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=155, OpenFileDescriptor=534, MaxFileDescriptor=60000, SystemLoadAverage=329, ProcessCount=165, AvailableMemoryMB=4107 2023-02-08 13:03:13,187 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/hadoop.log.dir so I do NOT create it in target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee 2023-02-08 13:03:13,187 WARN [Listener at localhost/46349] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/hadoop.log.dir Erasing configuration value by system value. 2023-02-08 13:03:13,187 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/hadoop.tmp.dir so I do NOT create it in target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee 2023-02-08 13:03:13,187 WARN [Listener at localhost/46349] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ca99eff-f039-6c24-e30d-9c40dcdf1019/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-08 13:03:13,187 DEBUG [Listener at localhost/46349] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee 2023-02-08 13:03:13,187 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 13:03:13,187 INFO [Listener at localhost/46349] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/cluster_7028dd61-03f9-e7cc-4bf7-aec869669eb8, deleteOnExit=true 2023-02-08 13:03:13,187 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 13:03:13,188 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/test.cache.data in system properties and HBase conf 2023-02-08 13:03:13,188 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 13:03:13,188 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/hadoop.log.dir in system properties and HBase conf 2023-02-08 13:03:13,188 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 13:03:13,188 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 13:03:13,188 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 13:03:13,188 DEBUG [Listener at localhost/46349] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 13:03:13,188 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:03:13,189 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:03:13,189 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 13:03:13,189 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:03:13,189 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 13:03:13,189 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 13:03:13,189 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:03:13,189 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:03:13,189 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 13:03:13,189 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/nfs.dump.dir in system properties and HBase conf 2023-02-08 13:03:13,189 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/java.io.tmpdir in system properties and HBase conf 2023-02-08 13:03:13,189 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:03:13,190 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 13:03:13,190 INFO [Listener at localhost/46349] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 13:03:13,194 WARN [Listener at localhost/46349] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:03:13,194 WARN [Listener at localhost/46349] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:03:13,241 WARN [Listener at localhost/46349] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:13,243 INFO [Listener at localhost/46349] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:13,248 INFO [Listener at localhost/46349] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/java.io.tmpdir/Jetty_localhost_39453_hdfs____.e483oq/webapp 2023-02-08 13:03:13,339 INFO [Listener at localhost/46349] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39453 2023-02-08 13:03:13,366 WARN [Listener at localhost/46349] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:03:13,366 WARN [Listener at localhost/46349] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:03:13,410 WARN [Listener at localhost/44459] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:13,422 WARN [Listener at localhost/44459] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:03:13,424 WARN [Listener at localhost/44459] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:13,425 INFO [Listener at localhost/44459] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:13,431 INFO [Listener at localhost/44459] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/java.io.tmpdir/Jetty_localhost_37683_datanode____.73c98/webapp 2023-02-08 13:03:13,521 INFO [Listener at localhost/44459] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37683 2023-02-08 13:03:13,530 WARN [Listener at localhost/38557] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:13,558 WARN [Listener at localhost/38557] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:03:13,561 WARN [Listener at localhost/38557] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:13,562 INFO [Listener at localhost/38557] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:13,565 INFO [Listener at localhost/38557] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/java.io.tmpdir/Jetty_localhost_43299_datanode____.a7r3ja/webapp 2023-02-08 13:03:13,649 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe787b8dda44925fa: Processing first storage report for DS-f0829ca1-3d81-4cdc-95af-d05f49e79a15 from datanode a9aab93e-d855-48ae-9a0a-b4460f12781f 2023-02-08 13:03:13,649 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe787b8dda44925fa: from storage DS-f0829ca1-3d81-4cdc-95af-d05f49e79a15 node DatanodeRegistration(127.0.0.1:34663, datanodeUuid=a9aab93e-d855-48ae-9a0a-b4460f12781f, infoPort=42625, infoSecurePort=0, ipcPort=38557, storageInfo=lv=-57;cid=testClusterID;nsid=954698303;c=1675861393196), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:13,649 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe787b8dda44925fa: Processing first storage report for DS-75066db8-9a1f-4a35-bff2-e15ae30aff88 from datanode a9aab93e-d855-48ae-9a0a-b4460f12781f 2023-02-08 13:03:13,649 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe787b8dda44925fa: from storage DS-75066db8-9a1f-4a35-bff2-e15ae30aff88 node DatanodeRegistration(127.0.0.1:34663, datanodeUuid=a9aab93e-d855-48ae-9a0a-b4460f12781f, infoPort=42625, infoSecurePort=0, ipcPort=38557, storageInfo=lv=-57;cid=testClusterID;nsid=954698303;c=1675861393196), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:13,669 INFO [Listener at localhost/38557] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43299 2023-02-08 13:03:13,678 WARN [Listener at localhost/35425] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:13,786 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x820e6b609723a2f3: Processing first storage report for DS-68746058-73b2-473b-bb8b-afdcbcbdf11f from datanode a0f8804b-abc0-41b7-a738-a4c775a95e56 2023-02-08 13:03:13,786 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x820e6b609723a2f3: from storage DS-68746058-73b2-473b-bb8b-afdcbcbdf11f node DatanodeRegistration(127.0.0.1:33947, datanodeUuid=a0f8804b-abc0-41b7-a738-a4c775a95e56, infoPort=41965, infoSecurePort=0, ipcPort=35425, storageInfo=lv=-57;cid=testClusterID;nsid=954698303;c=1675861393196), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:13,786 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x820e6b609723a2f3: Processing first storage report for DS-3eb61c9e-c4f8-4e9a-95df-41465ec6dc5b from datanode a0f8804b-abc0-41b7-a738-a4c775a95e56 2023-02-08 13:03:13,786 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x820e6b609723a2f3: from storage DS-3eb61c9e-c4f8-4e9a-95df-41465ec6dc5b node DatanodeRegistration(127.0.0.1:33947, datanodeUuid=a0f8804b-abc0-41b7-a738-a4c775a95e56, infoPort=41965, infoSecurePort=0, ipcPort=35425, storageInfo=lv=-57;cid=testClusterID;nsid=954698303;c=1675861393196), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:13,788 DEBUG [Listener at localhost/35425] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee 2023-02-08 13:03:13,790 INFO [Listener at localhost/35425] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/cluster_7028dd61-03f9-e7cc-4bf7-aec869669eb8/zookeeper_0, clientPort=64231, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/cluster_7028dd61-03f9-e7cc-4bf7-aec869669eb8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/cluster_7028dd61-03f9-e7cc-4bf7-aec869669eb8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 13:03:13,791 INFO [Listener at localhost/35425] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64231 2023-02-08 13:03:13,791 INFO [Listener at localhost/35425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:13,792 INFO [Listener at localhost/35425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:13,804 INFO [Listener at localhost/35425] util.FSUtils(479): Created version file at hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34 with version=8 2023-02-08 13:03:13,804 INFO [Listener at localhost/35425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:13,805 INFO [Listener at localhost/35425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:13,806 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44459/user/jenkins/test-data/11238197-f3df-f265-22b2-976db3019ef2/hbase-staging 2023-02-08 13:03:13,807 INFO [Listener at localhost/35425] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:13,808 INFO [Listener at localhost/35425] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:13,808 INFO [Listener at localhost/35425] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:13,808 INFO [Listener at localhost/35425] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:13,808 INFO [Listener at localhost/35425] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:13,808 INFO [Listener at localhost/35425] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:13,808 INFO [Listener at localhost/35425] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:13,809 INFO [Listener at localhost/35425] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44459 2023-02-08 13:03:13,809 INFO [Listener at localhost/35425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:13,810 INFO [Listener at localhost/35425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:13,811 INFO [Listener at localhost/35425] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44459 connecting to ZooKeeper ensemble=127.0.0.1:64231 2023-02-08 13:03:13,817 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:444590x0, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:13,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44459-0x10034076b420000 connected 2023-02-08 13:03:13,840 DEBUG [Listener at localhost/35425] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:13,840 DEBUG [Listener at localhost/35425] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:13,841 DEBUG [Listener at localhost/35425] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:13,843 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44459 2023-02-08 13:03:13,843 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44459 2023-02-08 13:03:13,843 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44459 2023-02-08 13:03:13,844 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44459 2023-02-08 13:03:13,847 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44459 2023-02-08 13:03:13,847 INFO [Listener at localhost/35425] master.HMaster(439): hbase.rootdir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34, hbase.cluster.distributed=false 2023-02-08 13:03:13,859 INFO [Listener at localhost/35425] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:13,859 INFO [Listener at localhost/35425] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:13,859 INFO [Listener at localhost/35425] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:13,859 INFO [Listener at localhost/35425] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:13,859 INFO [Listener at localhost/35425] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:13,859 INFO [Listener at localhost/35425] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:13,860 INFO [Listener at localhost/35425] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:13,861 INFO [Listener at localhost/35425] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44641 2023-02-08 13:03:13,861 INFO [Listener at localhost/35425] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:03:13,862 DEBUG [Listener at localhost/35425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:13,863 INFO [Listener at localhost/35425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:13,864 INFO [Listener at localhost/35425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:13,864 INFO [Listener at localhost/35425] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44641 connecting to ZooKeeper ensemble=127.0.0.1:64231 2023-02-08 13:03:13,867 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:446410x0, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:13,868 DEBUG [Listener at localhost/35425] zookeeper.ZKUtil(164): regionserver:446410x0, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:13,869 DEBUG [Listener at localhost/35425] zookeeper.ZKUtil(164): regionserver:446410x0, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:13,869 DEBUG [Listener at localhost/35425] zookeeper.ZKUtil(164): regionserver:446410x0, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:13,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44641-0x10034076b420001 connected 2023-02-08 13:03:13,872 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44641 2023-02-08 13:03:13,876 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44641 2023-02-08 13:03:13,876 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44641 2023-02-08 13:03:13,877 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44641 2023-02-08 13:03:13,877 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44641 2023-02-08 13:03:13,888 INFO [Listener at localhost/35425] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:13,888 INFO [Listener at localhost/35425] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:13,888 INFO [Listener at localhost/35425] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:13,888 INFO [Listener at localhost/35425] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:13,888 INFO [Listener at localhost/35425] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:13,888 INFO [Listener at localhost/35425] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:13,888 INFO [Listener at localhost/35425] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:13,891 INFO [Listener at localhost/35425] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46275 2023-02-08 13:03:13,891 INFO [Listener at localhost/35425] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:03:13,892 DEBUG [Listener at localhost/35425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:13,893 INFO [Listener at localhost/35425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:13,893 INFO [Listener at localhost/35425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:13,894 INFO [Listener at localhost/35425] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46275 connecting to ZooKeeper ensemble=127.0.0.1:64231 2023-02-08 13:03:13,899 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:462750x0, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:13,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46275-0x10034076b420002 connected 2023-02-08 13:03:13,902 DEBUG [Listener at localhost/35425] zookeeper.ZKUtil(164): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:13,902 DEBUG [Listener at localhost/35425] zookeeper.ZKUtil(164): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:13,903 DEBUG [Listener at localhost/35425] zookeeper.ZKUtil(164): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:13,904 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46275 2023-02-08 13:03:13,907 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46275 2023-02-08 13:03:13,908 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46275 2023-02-08 13:03:13,908 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46275 2023-02-08 13:03:13,909 DEBUG [Listener at localhost/35425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46275 2023-02-08 13:03:13,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44459,1675861393807 2023-02-08 13:03:13,912 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:03:13,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44459,1675861393807 2023-02-08 13:03:13,913 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:13,913 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:13,913 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:13,914 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:13,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:03:13,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44459,1675861393807 from backup master directory 2023-02-08 13:03:13,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:03:13,917 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44459,1675861393807 2023-02-08 13:03:13,917 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:03:13,917 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:13,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,44459,1675861393807 2023-02-08 13:03:13,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/hbase.id with ID: 25c546f0-6227-49cf-b9b7-d205b9cde205 2023-02-08 13:03:13,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:13,947 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:13,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x462d0483 to 127.0.0.1:64231 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:13,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e7c1e00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:13,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:13,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 13:03:13,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:13,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/MasterData/data/master/store-tmp 2023-02-08 13:03:13,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:13,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:03:13,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:13,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:13,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:03:13,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:13,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:13,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861393972Disabling compacts and flushes for region at 1675861393972Disabling writes for close at 1675861393972Writing region close event to WAL at 1675861393972Closed at 1675861393972 2023-02-08 13:03:13,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/MasterData/WALs/jenkins-hbase4.apache.org,44459,1675861393807 2023-02-08 13:03:13,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44459%2C1675861393807, suffix=, logDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/MasterData/WALs/jenkins-hbase4.apache.org,44459,1675861393807, archiveDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/MasterData/oldWALs, maxLogs=10 2023-02-08 13:03:13,990 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34663,DS-f0829ca1-3d81-4cdc-95af-d05f49e79a15,DISK] 2023-02-08 13:03:13,990 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33947,DS-68746058-73b2-473b-bb8b-afdcbcbdf11f,DISK] 2023-02-08 13:03:13,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/MasterData/WALs/jenkins-hbase4.apache.org,44459,1675861393807/jenkins-hbase4.apache.org%2C44459%2C1675861393807.1675861393975 2023-02-08 13:03:13,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34663,DS-f0829ca1-3d81-4cdc-95af-d05f49e79a15,DISK], DatanodeInfoWithStorage[127.0.0.1:33947,DS-68746058-73b2-473b-bb8b-afdcbcbdf11f,DISK]] 2023-02-08 13:03:13,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:13,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:13,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:13,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:13,997 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:13,999 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 13:03:13,999 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 13:03:13,999 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:14,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:14,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:14,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:14,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:14,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68888355, jitterRate=0.02651648223400116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:03:14,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675861393996Initializing all the Stores at 1675861393997 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861393997Cleaning up temporary data from old regions at 1675861394001 (+4 ms)Cleaning up detritus from prior splits at 1675861394001Region opened successfully at 1675861394005 (+4 ms) 2023-02-08 13:03:14,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 13:03:14,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 13:03:14,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 13:03:14,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 13:03:14,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-08 13:03:14,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-08 13:03:14,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 13:03:14,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 13:03:14,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 13:03:14,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 13:03:14,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 13:03:14,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 13:03:14,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 13:03:14,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 13:03:14,025 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:14,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 13:03:14,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 13:03:14,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 13:03:14,028 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:14,028 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:14,028 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:14,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,44459,1675861393807, sessionid=0x10034076b420000, setting cluster-up flag (Was=false) 2023-02-08 13:03:14,032 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:14,036 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:14,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 13:03:14,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44459,1675861393807 2023-02-08 13:03:14,044 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:14,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 13:03:14,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44459,1675861393807 2023-02-08 13:03:14,049 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.hbase-snapshot/.tmp 2023-02-08 13:03:14,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:14,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:14,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:14,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:14,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:14,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 13:03:14,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:14,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675861424053 2023-02-08 13:03:14,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 13:03:14,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 13:03:14,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 13:03:14,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 13:03:14,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 13:03:14,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 13:03:14,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,053 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:14,053 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 13:03:14,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 13:03:14,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 13:03:14,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 13:03:14,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 13:03:14,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 13:03:14,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861394054,5,FailOnTimeoutGroup] 2023-02-08 13:03:14,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861394055,5,FailOnTimeoutGroup] 2023-02-08 13:03:14,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 13:03:14,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,055 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:14,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,070 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:14,071 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:14,071 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34 2023-02-08 13:03:14,083 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:14,084 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:03:14,086 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/info 2023-02-08 13:03:14,086 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:03:14,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:14,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:03:14,088 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:14,088 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:03:14,089 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:14,089 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:03:14,090 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/table 2023-02-08 13:03:14,090 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:03:14,090 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:14,091 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740 2023-02-08 13:03:14,091 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740 2023-02-08 13:03:14,093 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:03:14,094 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:03:14,095 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:14,096 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75109564, jitterRate=0.11921972036361694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:03:14,096 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675861394083Initializing all the Stores at 1675861394084 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861394084Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861394084Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861394084Cleaning up temporary data from old regions at 1675861394092 (+8 ms)Cleaning up detritus from prior splits at 1675861394092Region opened successfully at 1675861394096 (+4 ms) 2023-02-08 13:03:14,096 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:03:14,096 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:03:14,096 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:03:14,096 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:03:14,096 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:03:14,096 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:14,096 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861394096Disabling compacts and flushes for region at 1675861394096Disabling writes for close at 1675861394096Writing region close event to WAL at 1675861394096Closed at 1675861394096 2023-02-08 13:03:14,097 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:14,097 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 13:03:14,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 13:03:14,099 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 13:03:14,100 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 13:03:14,111 INFO [RS:0;jenkins-hbase4:44641] regionserver.HRegionServer(952): ClusterId : 25c546f0-6227-49cf-b9b7-d205b9cde205 2023-02-08 13:03:14,111 DEBUG [RS:0;jenkins-hbase4:44641] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:03:14,111 INFO [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(952): ClusterId : 25c546f0-6227-49cf-b9b7-d205b9cde205 2023-02-08 13:03:14,111 DEBUG [RS:1;jenkins-hbase4:46275] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:03:14,113 DEBUG [RS:0;jenkins-hbase4:44641] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:03:14,113 DEBUG [RS:0;jenkins-hbase4:44641] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:03:14,113 DEBUG [RS:1;jenkins-hbase4:46275] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:03:14,114 DEBUG [RS:1;jenkins-hbase4:46275] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:03:14,116 DEBUG [RS:0;jenkins-hbase4:44641] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:03:14,117 DEBUG [RS:0;jenkins-hbase4:44641] zookeeper.ReadOnlyZKClient(139): Connect 0x18aa2cfb to 127.0.0.1:64231 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:14,117 DEBUG [RS:1;jenkins-hbase4:46275] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:03:14,118 DEBUG [RS:1;jenkins-hbase4:46275] zookeeper.ReadOnlyZKClient(139): Connect 0x58312236 to 127.0.0.1:64231 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:14,128 DEBUG [RS:0;jenkins-hbase4:44641] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@166dc19e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:14,128 DEBUG [RS:0;jenkins-hbase4:44641] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1252478b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:14,134 DEBUG [RS:1;jenkins-hbase4:46275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56f6d740, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:14,134 DEBUG [RS:1;jenkins-hbase4:46275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52c94946, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:14,139 DEBUG [RS:0;jenkins-hbase4:44641] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44641 2023-02-08 13:03:14,139 INFO [RS:0;jenkins-hbase4:44641] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:03:14,139 INFO [RS:0;jenkins-hbase4:44641] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:03:14,139 DEBUG [RS:0;jenkins-hbase4:44641] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:03:14,139 INFO [RS:0;jenkins-hbase4:44641] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44459,1675861393807 with isa=jenkins-hbase4.apache.org/172.31.14.131:44641, startcode=1675861393859 2023-02-08 13:03:14,140 DEBUG [RS:0;jenkins-hbase4:44641] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:03:14,141 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51325, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:03:14,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:14,143 DEBUG [RS:1;jenkins-hbase4:46275] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46275 2023-02-08 13:03:14,143 DEBUG [RS:0;jenkins-hbase4:44641] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34 2023-02-08 13:03:14,143 INFO [RS:1;jenkins-hbase4:46275] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:03:14,143 INFO [RS:1;jenkins-hbase4:46275] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:03:14,143 DEBUG [RS:0;jenkins-hbase4:44641] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44459 2023-02-08 13:03:14,143 DEBUG [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:03:14,144 DEBUG [RS:0;jenkins-hbase4:44641] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:03:14,144 INFO [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44459,1675861393807 with isa=jenkins-hbase4.apache.org/172.31.14.131:46275, startcode=1675861393887 2023-02-08 13:03:14,144 DEBUG [RS:1;jenkins-hbase4:46275] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:03:14,146 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51705, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:03:14,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:14,147 DEBUG [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34 2023-02-08 13:03:14,147 DEBUG [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44459 2023-02-08 13:03:14,147 DEBUG [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:03:14,149 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:14,152 DEBUG [RS:0;jenkins-hbase4:44641] zookeeper.ZKUtil(162): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:14,152 WARN [RS:0;jenkins-hbase4:44641] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:14,152 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46275,1675861393887] 2023-02-08 13:03:14,152 INFO [RS:0;jenkins-hbase4:44641] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:14,152 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44641,1675861393859] 2023-02-08 13:03:14,152 DEBUG [RS:0;jenkins-hbase4:44641] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/WALs/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:14,153 DEBUG [RS:1;jenkins-hbase4:46275] zookeeper.ZKUtil(162): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:14,153 WARN [RS:1;jenkins-hbase4:46275] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:14,153 INFO [RS:1;jenkins-hbase4:46275] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:14,153 DEBUG [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/WALs/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:14,157 DEBUG [RS:0;jenkins-hbase4:44641] zookeeper.ZKUtil(162): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:14,157 DEBUG [RS:1;jenkins-hbase4:46275] zookeeper.ZKUtil(162): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:14,157 DEBUG [RS:0;jenkins-hbase4:44641] zookeeper.ZKUtil(162): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:14,157 DEBUG [RS:1;jenkins-hbase4:46275] zookeeper.ZKUtil(162): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:14,158 DEBUG [RS:0;jenkins-hbase4:44641] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:03:14,158 DEBUG [RS:1;jenkins-hbase4:46275] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:03:14,158 INFO [RS:0;jenkins-hbase4:44641] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:03:14,158 INFO [RS:1;jenkins-hbase4:46275] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:03:14,159 INFO [RS:0;jenkins-hbase4:44641] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:03:14,160 INFO [RS:0;jenkins-hbase4:44641] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:03:14,160 INFO [RS:0;jenkins-hbase4:44641] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,164 INFO [RS:0;jenkins-hbase4:44641] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:03:14,164 INFO [RS:1;jenkins-hbase4:46275] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:03:14,165 INFO [RS:1;jenkins-hbase4:46275] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:03:14,165 INFO [RS:1;jenkins-hbase4:46275] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,165 INFO [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:03:14,165 INFO [RS:0;jenkins-hbase4:44641] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,165 DEBUG [RS:0;jenkins-hbase4:44641] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,165 DEBUG [RS:0;jenkins-hbase4:44641] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,165 DEBUG [RS:0;jenkins-hbase4:44641] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,166 DEBUG [RS:0;jenkins-hbase4:44641] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,166 DEBUG [RS:0;jenkins-hbase4:44641] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,166 DEBUG [RS:0;jenkins-hbase4:44641] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:14,166 DEBUG [RS:0;jenkins-hbase4:44641] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,166 DEBUG [RS:0;jenkins-hbase4:44641] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,166 DEBUG [RS:0;jenkins-hbase4:44641] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,166 INFO [RS:1;jenkins-hbase4:46275] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,166 DEBUG [RS:0;jenkins-hbase4:44641] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,166 DEBUG [RS:1;jenkins-hbase4:46275] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,166 DEBUG [RS:1;jenkins-hbase4:46275] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,167 DEBUG [RS:1;jenkins-hbase4:46275] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,167 INFO [RS:0;jenkins-hbase4:44641] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,167 DEBUG [RS:1;jenkins-hbase4:46275] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,167 INFO [RS:0;jenkins-hbase4:44641] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,167 DEBUG [RS:1;jenkins-hbase4:46275] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,167 INFO [RS:0;jenkins-hbase4:44641] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,167 DEBUG [RS:1;jenkins-hbase4:46275] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:14,167 DEBUG [RS:1;jenkins-hbase4:46275] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,167 DEBUG [RS:1;jenkins-hbase4:46275] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,167 DEBUG [RS:1;jenkins-hbase4:46275] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,167 DEBUG [RS:1;jenkins-hbase4:46275] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:14,171 INFO [RS:1;jenkins-hbase4:46275] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,171 INFO [RS:1;jenkins-hbase4:46275] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,171 INFO [RS:1;jenkins-hbase4:46275] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,179 INFO [RS:0;jenkins-hbase4:44641] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:03:14,179 INFO [RS:0;jenkins-hbase4:44641] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44641,1675861393859-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,181 INFO [RS:1;jenkins-hbase4:46275] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:03:14,182 INFO [RS:1;jenkins-hbase4:46275] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46275,1675861393887-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,190 INFO [RS:0;jenkins-hbase4:44641] regionserver.Replication(203): jenkins-hbase4.apache.org,44641,1675861393859 started 2023-02-08 13:03:14,190 INFO [RS:0;jenkins-hbase4:44641] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44641,1675861393859, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44641, sessionid=0x10034076b420001 2023-02-08 13:03:14,190 DEBUG [RS:0;jenkins-hbase4:44641] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:03:14,190 DEBUG [RS:0;jenkins-hbase4:44641] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:14,190 DEBUG [RS:0;jenkins-hbase4:44641] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44641,1675861393859' 2023-02-08 13:03:14,190 DEBUG [RS:0;jenkins-hbase4:44641] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:14,190 DEBUG [RS:0;jenkins-hbase4:44641] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:14,191 DEBUG [RS:0;jenkins-hbase4:44641] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:03:14,191 DEBUG [RS:0;jenkins-hbase4:44641] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:03:14,191 DEBUG [RS:0;jenkins-hbase4:44641] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:14,191 DEBUG [RS:0;jenkins-hbase4:44641] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44641,1675861393859' 2023-02-08 13:03:14,191 DEBUG [RS:0;jenkins-hbase4:44641] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:14,191 DEBUG [RS:0;jenkins-hbase4:44641] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:14,191 DEBUG [RS:0;jenkins-hbase4:44641] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:03:14,192 INFO [RS:0;jenkins-hbase4:44641] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:03:14,192 INFO [RS:0;jenkins-hbase4:44641] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:03:14,192 INFO [RS:1;jenkins-hbase4:46275] regionserver.Replication(203): jenkins-hbase4.apache.org,46275,1675861393887 started 2023-02-08 13:03:14,192 INFO [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46275,1675861393887, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46275, sessionid=0x10034076b420002 2023-02-08 13:03:14,192 DEBUG [RS:1;jenkins-hbase4:46275] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:03:14,192 DEBUG [RS:1;jenkins-hbase4:46275] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:14,192 DEBUG [RS:1;jenkins-hbase4:46275] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46275,1675861393887' 2023-02-08 13:03:14,192 DEBUG [RS:1;jenkins-hbase4:46275] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:14,192 DEBUG [RS:1;jenkins-hbase4:46275] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:14,193 DEBUG [RS:1;jenkins-hbase4:46275] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:03:14,193 DEBUG [RS:1;jenkins-hbase4:46275] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:03:14,193 DEBUG [RS:1;jenkins-hbase4:46275] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:14,193 DEBUG [RS:1;jenkins-hbase4:46275] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46275,1675861393887' 2023-02-08 13:03:14,193 DEBUG [RS:1;jenkins-hbase4:46275] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:14,193 DEBUG [RS:1;jenkins-hbase4:46275] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:14,193 DEBUG [RS:1;jenkins-hbase4:46275] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:03:14,193 INFO [RS:1;jenkins-hbase4:46275] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:03:14,193 INFO [RS:1;jenkins-hbase4:46275] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:03:14,250 DEBUG [jenkins-hbase4:44459] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 13:03:14,251 DEBUG [jenkins-hbase4:44459] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:14,252 DEBUG [jenkins-hbase4:44459] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:14,252 DEBUG [jenkins-hbase4:44459] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:14,252 DEBUG [jenkins-hbase4:44459] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:14,253 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46275,1675861393887, state=OPENING 2023-02-08 13:03:14,255 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 13:03:14,256 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:14,257 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46275,1675861393887}] 2023-02-08 13:03:14,257 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:03:14,411 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:14,411 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 13:03:14,412 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42760, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 13:03:14,416 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 13:03:14,417 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:14,418 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46275%2C1675861393887.meta, suffix=.meta, logDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/WALs/jenkins-hbase4.apache.org,46275,1675861393887, archiveDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/oldWALs, maxLogs=32 2023-02-08 13:03:14,432 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34663,DS-f0829ca1-3d81-4cdc-95af-d05f49e79a15,DISK] 2023-02-08 13:03:14,432 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33947,DS-68746058-73b2-473b-bb8b-afdcbcbdf11f,DISK] 2023-02-08 13:03:14,434 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/WALs/jenkins-hbase4.apache.org,46275,1675861393887/jenkins-hbase4.apache.org%2C46275%2C1675861393887.meta.1675861394418.meta 2023-02-08 13:03:14,434 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33947,DS-68746058-73b2-473b-bb8b-afdcbcbdf11f,DISK], DatanodeInfoWithStorage[127.0.0.1:34663,DS-f0829ca1-3d81-4cdc-95af-d05f49e79a15,DISK]] 2023-02-08 13:03:14,434 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:14,434 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 13:03:14,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 13:03:14,435 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 13:03:14,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 13:03:14,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:14,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 13:03:14,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 13:03:14,436 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:03:14,437 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/info 2023-02-08 13:03:14,437 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/info 2023-02-08 13:03:14,437 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:03:14,437 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:14,438 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:03:14,438 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:14,438 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:14,439 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:03:14,439 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:14,439 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:03:14,440 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/table 2023-02-08 13:03:14,440 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/table 2023-02-08 13:03:14,440 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:03:14,441 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:14,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740 2023-02-08 13:03:14,442 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740 2023-02-08 13:03:14,444 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:03:14,445 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:03:14,446 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66509992, jitterRate=-0.008923888206481934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:03:14,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675861394435Writing region info on filesystem at 1675861394435Initializing all the Stores at 1675861394436 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861394436Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861394436Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861394436Cleaning up temporary data from old regions at 1675861394443 (+7 ms)Cleaning up detritus from prior splits at 1675861394443Running coprocessor post-open hooks at 1675861394446 (+3 ms)Region opened successfully at 1675861394446 2023-02-08 13:03:14,446 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675861394411 2023-02-08 13:03:14,450 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 13:03:14,450 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 13:03:14,450 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46275,1675861393887, state=OPEN 2023-02-08 13:03:14,452 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 13:03:14,452 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:03:14,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 13:03:14,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46275,1675861393887 in 195 msec 2023-02-08 13:03:14,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 13:03:14,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-08 13:03:14,457 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 406 msec 2023-02-08 13:03:14,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675861393912, completionTime=-1 2023-02-08 13:03:14,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 13:03:14,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 13:03:14,460 DEBUG [hconnection-0x163248db-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:14,461 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42762, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:14,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 13:03:14,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675861454463 2023-02-08 13:03:14,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675861514463 2023-02-08 13:03:14,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-08 13:03:14,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44459,1675861393807-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44459,1675861393807-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44459,1675861393807-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44459, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:14,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 13:03:14,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:14,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 13:03:14,478 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:03:14,478 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 13:03:14,479 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:03:14,480 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/hbase/namespace/ef8ccb8da4d3d11df2285cadee57481d 2023-02-08 13:03:14,481 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/hbase/namespace/ef8ccb8da4d3d11df2285cadee57481d empty. 2023-02-08 13:03:14,481 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/hbase/namespace/ef8ccb8da4d3d11df2285cadee57481d 2023-02-08 13:03:14,481 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 13:03:14,493 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:14,494 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ef8ccb8da4d3d11df2285cadee57481d, NAME => 'hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp 2023-02-08 13:03:14,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:14,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ef8ccb8da4d3d11df2285cadee57481d, disabling compactions & flushes 2023-02-08 13:03:14,501 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. 2023-02-08 13:03:14,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. 2023-02-08 13:03:14,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. after waiting 0 ms 2023-02-08 13:03:14,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. 2023-02-08 13:03:14,501 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. 2023-02-08 13:03:14,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ef8ccb8da4d3d11df2285cadee57481d: Waiting for close lock at 1675861394501Disabling compacts and flushes for region at 1675861394501Disabling writes for close at 1675861394501Writing region close event to WAL at 1675861394501Closed at 1675861394501 2023-02-08 13:03:14,503 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:03:14,504 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861394504"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861394504"}]},"ts":"1675861394504"} 2023-02-08 13:03:14,506 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 13:03:14,506 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:03:14,507 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861394506"}]},"ts":"1675861394506"} 2023-02-08 13:03:14,508 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 13:03:14,512 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:14,513 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:14,513 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:14,513 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:14,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ef8ccb8da4d3d11df2285cadee57481d, ASSIGN}] 2023-02-08 13:03:14,515 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ef8ccb8da4d3d11df2285cadee57481d, ASSIGN 2023-02-08 13:03:14,516 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ef8ccb8da4d3d11df2285cadee57481d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46275,1675861393887; forceNewPlan=false, retain=false 2023-02-08 13:03:14,666 INFO [jenkins-hbase4:44459] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 13:03:14,667 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ef8ccb8da4d3d11df2285cadee57481d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:14,667 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861394667"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861394667"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861394667"}]},"ts":"1675861394667"} 2023-02-08 13:03:14,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ef8ccb8da4d3d11df2285cadee57481d, server=jenkins-hbase4.apache.org,46275,1675861393887}] 2023-02-08 13:03:14,824 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. 2023-02-08 13:03:14,826 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46275%2C1675861393887, suffix=, logDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/WALs/jenkins-hbase4.apache.org,46275,1675861393887, archiveDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/oldWALs, maxLogs=32 2023-02-08 13:03:14,840 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33947,DS-68746058-73b2-473b-bb8b-afdcbcbdf11f,DISK] 2023-02-08 13:03:14,841 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34663,DS-f0829ca1-3d81-4cdc-95af-d05f49e79a15,DISK] 2023-02-08 13:03:14,842 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/WALs/jenkins-hbase4.apache.org,46275,1675861393887/jenkins-hbase4.apache.org%2C46275%2C1675861393887.1675861394827 2023-02-08 13:03:14,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33947,DS-68746058-73b2-473b-bb8b-afdcbcbdf11f,DISK], DatanodeInfoWithStorage[127.0.0.1:34663,DS-f0829ca1-3d81-4cdc-95af-d05f49e79a15,DISK]] 2023-02-08 13:03:14,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ef8ccb8da4d3d11df2285cadee57481d, NAME => 'hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:14,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ef8ccb8da4d3d11df2285cadee57481d 2023-02-08 13:03:14,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:14,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ef8ccb8da4d3d11df2285cadee57481d 2023-02-08 13:03:14,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ef8ccb8da4d3d11df2285cadee57481d 2023-02-08 13:03:14,846 INFO [StoreOpener-ef8ccb8da4d3d11df2285cadee57481d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ef8ccb8da4d3d11df2285cadee57481d 2023-02-08 13:03:14,847 DEBUG [StoreOpener-ef8ccb8da4d3d11df2285cadee57481d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/namespace/ef8ccb8da4d3d11df2285cadee57481d/info 2023-02-08 13:03:14,847 DEBUG [StoreOpener-ef8ccb8da4d3d11df2285cadee57481d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/namespace/ef8ccb8da4d3d11df2285cadee57481d/info 2023-02-08 13:03:14,848 INFO [StoreOpener-ef8ccb8da4d3d11df2285cadee57481d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef8ccb8da4d3d11df2285cadee57481d columnFamilyName info 2023-02-08 13:03:14,848 INFO [StoreOpener-ef8ccb8da4d3d11df2285cadee57481d-1] regionserver.HStore(310): Store=ef8ccb8da4d3d11df2285cadee57481d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:14,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/namespace/ef8ccb8da4d3d11df2285cadee57481d 2023-02-08 13:03:14,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/namespace/ef8ccb8da4d3d11df2285cadee57481d 2023-02-08 13:03:14,852 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ef8ccb8da4d3d11df2285cadee57481d 2023-02-08 13:03:14,853 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/namespace/ef8ccb8da4d3d11df2285cadee57481d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:14,854 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ef8ccb8da4d3d11df2285cadee57481d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70685461, jitterRate=0.053295448422431946}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:03:14,854 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ef8ccb8da4d3d11df2285cadee57481d: Running coprocessor pre-open hook at 1675861394843Writing region info on filesystem at 1675861394843Initializing all the Stores at 1675861394844 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861394844Cleaning up temporary data from old regions at 1675861394849 (+5 ms)Cleaning up detritus from prior splits at 1675861394850 (+1 ms)Running coprocessor post-open hooks at 1675861394854 (+4 ms)Region opened successfully at 1675861394854 2023-02-08 13:03:14,854 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d., pid=6, masterSystemTime=1675861394821 2023-02-08 13:03:14,856 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. 2023-02-08 13:03:14,856 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. 2023-02-08 13:03:14,856 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ef8ccb8da4d3d11df2285cadee57481d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:14,857 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861394856"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861394856"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861394856"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861394856"}]},"ts":"1675861394856"} 2023-02-08 13:03:14,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 13:03:14,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ef8ccb8da4d3d11df2285cadee57481d, server=jenkins-hbase4.apache.org,46275,1675861393887 in 189 msec 2023-02-08 13:03:14,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 13:03:14,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ef8ccb8da4d3d11df2285cadee57481d, ASSIGN in 346 msec 2023-02-08 13:03:14,862 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:03:14,862 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861394862"}]},"ts":"1675861394862"} 2023-02-08 13:03:14,864 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 13:03:14,866 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:03:14,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 395 msec 2023-02-08 13:03:14,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 13:03:14,873 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:14,874 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:14,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 13:03:14,889 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:14,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-08 13:03:14,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 13:03:14,908 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:14,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-08 13:03:14,916 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 13:03:14,918 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 13:03:14,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.001sec 2023-02-08 13:03:14,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 13:03:14,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 13:03:14,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 13:03:14,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44459,1675861393807-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 13:03:14,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44459,1675861393807-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 13:03:14,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 13:03:15,012 DEBUG [Listener at localhost/35425] zookeeper.ReadOnlyZKClient(139): Connect 0x10a0070e to 127.0.0.1:64231 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:15,018 DEBUG [Listener at localhost/35425] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f4fc1ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:15,019 DEBUG [hconnection-0x3f3ec1c9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:15,021 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42774, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:15,023 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44459,1675861393807 2023-02-08 13:03:15,023 DEBUG [Listener at localhost/35425] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 13:03:15,023 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:15,023 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:15,025 DEBUG [Listener at localhost/35425] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 13:03:15,027 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48530, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 13:03:15,027 INFO [Listener at localhost/35425] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:15,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:15,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 13:03:15,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:48530 deadline: 1675861455027, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:15,028 INFO [Listener at localhost/35425] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-08 13:03:15,029 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:15,029 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:15,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:15,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:15,033 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:03:15,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-08 13:03:15,033 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:15,033 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:15,033 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:03:15,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:15,035 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:15,036 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48 empty. 2023-02-08 13:03:15,036 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:15,036 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-08 13:03:15,126 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:15,127 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => aee4ebd3b9018cffc4286106bbaa3d48, NAME => 'testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp 2023-02-08 13:03:15,136 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:15,136 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:15,136 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:15,137 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing aee4ebd3b9018cffc4286106bbaa3d48, disabling compactions & flushes 2023-02-08 13:03:15,137 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:15,137 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:15,137 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. after waiting 0 ms 2023-02-08 13:03:15,137 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:15,137 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:15,137 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for aee4ebd3b9018cffc4286106bbaa3d48: Waiting for close lock at 1675861395137Disabling compacts and flushes for region at 1675861395137Disabling writes for close at 1675861395137Writing region close event to WAL at 1675861395137Closed at 1675861395137 2023-02-08 13:03:15,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:15,139 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:03:15,140 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675861395140"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861395140"}]},"ts":"1675861395140"} 2023-02-08 13:03:15,141 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 13:03:15,142 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:03:15,142 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861395142"}]},"ts":"1675861395142"} 2023-02-08 13:03:15,143 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-08 13:03:15,146 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:15,147 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:15,147 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:15,147 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:15,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aee4ebd3b9018cffc4286106bbaa3d48, ASSIGN}] 2023-02-08 13:03:15,149 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aee4ebd3b9018cffc4286106bbaa3d48, ASSIGN 2023-02-08 13:03:15,149 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aee4ebd3b9018cffc4286106bbaa3d48, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46275,1675861393887; forceNewPlan=false, retain=false 2023-02-08 13:03:15,193 INFO [RS:0;jenkins-hbase4:44641] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44641%2C1675861393859, suffix=, logDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/WALs/jenkins-hbase4.apache.org,44641,1675861393859, archiveDir=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/oldWALs, maxLogs=32 2023-02-08 13:03:15,208 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33947,DS-68746058-73b2-473b-bb8b-afdcbcbdf11f,DISK] 2023-02-08 13:03:15,208 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34663,DS-f0829ca1-3d81-4cdc-95af-d05f49e79a15,DISK] 2023-02-08 13:03:15,210 INFO [RS:0;jenkins-hbase4:44641] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/WALs/jenkins-hbase4.apache.org,44641,1675861393859/jenkins-hbase4.apache.org%2C44641%2C1675861393859.1675861395194 2023-02-08 13:03:15,211 DEBUG [RS:0;jenkins-hbase4:44641] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34663,DS-f0829ca1-3d81-4cdc-95af-d05f49e79a15,DISK], DatanodeInfoWithStorage[127.0.0.1:33947,DS-68746058-73b2-473b-bb8b-afdcbcbdf11f,DISK]] 2023-02-08 13:03:15,300 INFO [jenkins-hbase4:44459] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 13:03:15,301 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aee4ebd3b9018cffc4286106bbaa3d48, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,301 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675861395301"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861395301"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861395301"}]},"ts":"1675861395301"} 2023-02-08 13:03:15,303 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure aee4ebd3b9018cffc4286106bbaa3d48, server=jenkins-hbase4.apache.org,46275,1675861393887}] 2023-02-08 13:03:15,338 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:15,338 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:15,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:15,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:15,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aee4ebd3b9018cffc4286106bbaa3d48, NAME => 'testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:15,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:15,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:15,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:15,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:15,460 INFO [StoreOpener-aee4ebd3b9018cffc4286106bbaa3d48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:15,461 DEBUG [StoreOpener-aee4ebd3b9018cffc4286106bbaa3d48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f1 2023-02-08 13:03:15,461 DEBUG [StoreOpener-aee4ebd3b9018cffc4286106bbaa3d48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f1 2023-02-08 13:03:15,462 INFO [StoreOpener-aee4ebd3b9018cffc4286106bbaa3d48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aee4ebd3b9018cffc4286106bbaa3d48 columnFamilyName f1 2023-02-08 13:03:15,462 INFO [StoreOpener-aee4ebd3b9018cffc4286106bbaa3d48-1] regionserver.HStore(310): Store=aee4ebd3b9018cffc4286106bbaa3d48/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:15,462 INFO [StoreOpener-aee4ebd3b9018cffc4286106bbaa3d48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:15,463 DEBUG [StoreOpener-aee4ebd3b9018cffc4286106bbaa3d48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f2 2023-02-08 13:03:15,463 DEBUG [StoreOpener-aee4ebd3b9018cffc4286106bbaa3d48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f2 2023-02-08 13:03:15,464 INFO [StoreOpener-aee4ebd3b9018cffc4286106bbaa3d48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aee4ebd3b9018cffc4286106bbaa3d48 columnFamilyName f2 2023-02-08 13:03:15,464 INFO [StoreOpener-aee4ebd3b9018cffc4286106bbaa3d48-1] regionserver.HStore(310): Store=aee4ebd3b9018cffc4286106bbaa3d48/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:15,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:15,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:15,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:15,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:15,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:15,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened aee4ebd3b9018cffc4286106bbaa3d48; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59271040, jitterRate=-0.11679267883300781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:15,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for aee4ebd3b9018cffc4286106bbaa3d48: Running coprocessor pre-open hook at 1675861395459Writing region info on filesystem at 1675861395459Initializing all the Stores at 1675861395460 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861395460Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861395460Cleaning up temporary data from old regions at 1675861395465 (+5 ms)Cleaning up detritus from prior splits at 1675861395466 (+1 ms)Running coprocessor post-open hooks at 1675861395469 (+3 ms)Region opened successfully at 1675861395469 2023-02-08 13:03:15,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48., pid=12, masterSystemTime=1675861395455 2023-02-08 13:03:15,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:15,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:15,472 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aee4ebd3b9018cffc4286106bbaa3d48, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,472 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675861395472"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861395472"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861395472"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861395472"}]},"ts":"1675861395472"} 2023-02-08 13:03:15,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-08 13:03:15,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure aee4ebd3b9018cffc4286106bbaa3d48, server=jenkins-hbase4.apache.org,46275,1675861393887 in 170 msec 2023-02-08 13:03:15,476 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-08 13:03:15,476 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aee4ebd3b9018cffc4286106bbaa3d48, ASSIGN in 328 msec 2023-02-08 13:03:15,477 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:03:15,477 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861395477"}]},"ts":"1675861395477"} 2023-02-08 13:03:15,478 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-08 13:03:15,481 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:03:15,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 450 msec 2023-02-08 13:03:15,640 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:15,640 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:15,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:15,642 INFO [Listener at localhost/35425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-08 13:03:15,642 DEBUG [Listener at localhost/35425] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-08 13:03:15,642 INFO [Listener at localhost/35425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:03:15,644 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-08 13:03:15,645 INFO [Listener at localhost/35425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:03:15,645 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-08 13:03:15,645 INFO [Listener at localhost/35425] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 13:03:15,689 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46275] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:15,803 INFO [Listener at localhost/35425] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 13:03:15,803 INFO [Listener at localhost/35425] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 13:03:15,803 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:15,804 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:15,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-08 13:03:15,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675861395805 (current time:1675861395805). 2023-02-08 13:03:15,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 13:03:15,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] zookeeper.ReadOnlyZKClient(139): Connect 0x517a6017 to 127.0.0.1:64231 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:15,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6171742e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:15,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:15,814 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42786, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:15,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x517a6017 to 127.0.0.1:64231 2023-02-08 13:03:15,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:15,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 13:03:15,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-08 13:03:15,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-08 13:03:15,819 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-08 13:03:15,819 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1675861995819 2023-02-08 13:03:15,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-08 13:03:15,820 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:15,820 DEBUG [Listener at localhost/35425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 13:03:15,820 DEBUG [Listener at localhost/35425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 13:03:15,821 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-08 13:03:15,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-08 13:03:15,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-08 13:03:15,823 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-08 13:03:15,823 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1675861995823 2023-02-08 13:03:15,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-08 13:03:15,837 INFO [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-08 13:03:15,837 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:15,838 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-08 13:03:15,838 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-08 13:03:15,838 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,838 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-08 13:03:15,840 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:15,840 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:15,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:15,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:15,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:15,840 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:15,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-08 13:03:15,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-08 13:03:15,840 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,840 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:03:15,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-08 13:03:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-08 13:03:15,841 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-08 13:03:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-08 13:03:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-08 13:03:15,841 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-08 13:03:15,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-08 13:03:15,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-08 13:03:15,841 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-08 13:03:15,841 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:15,841 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-08 13:03:15,842 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:15,842 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-08 13:03:15,842 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-08 13:03:15,842 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-08 13:03:15,842 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46275,1675861393887' joining acquired barrier for procedure (foo) in zk 2023-02-08 13:03:15,842 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-08 13:03:15,842 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44641,1675861393859' joining acquired barrier for procedure (foo) in zk 2023-02-08 13:03:15,844 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,844 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:15,845 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:15,845 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-08 13:03:15,846 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:15,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:15,846 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-08 13:03:15,846 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 13:03:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:15,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46275,1675861393887' joining acquired barrier for procedure 'foo' on coordinator 2023-02-08 13:03:15,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@537f39eb[Count = 0] remaining members to acquire global barrier 2023-02-08 13:03:15,847 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-08 13:03:15,847 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:15,848 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 13:03:15,848 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 13:03:15,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:15,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:15,849 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-08 13:03:15,849 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-08 13:03:15,849 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,849 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:03:15,849 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-08 13:03:15,849 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,44641,1675861393859' in zk 2023-02-08 13:03:15,849 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-08 13:03:15,849 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 13:03:15,849 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:15,849 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. started... 2023-02-08 13:03:15,850 INFO [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] regionserver.HRegion(2744): Flushing aee4ebd3b9018cffc4286106bbaa3d48 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-08 13:03:15,851 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-08 13:03:15,851 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:15,851 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-08 13:03:15,873 INFO [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/.tmp/f1/9bfeaa6741cd4aad86d3f2817f334c65 2023-02-08 13:03:15,899 INFO [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/.tmp/f2/56c038a914654beaa42b7af957e758c4 2023-02-08 13:03:15,904 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/.tmp/f1/9bfeaa6741cd4aad86d3f2817f334c65 as hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f1/9bfeaa6741cd4aad86d3f2817f334c65 2023-02-08 13:03:15,908 INFO [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f1/9bfeaa6741cd4aad86d3f2817f334c65, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 13:03:15,909 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/.tmp/f2/56c038a914654beaa42b7af957e758c4 as hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f2/56c038a914654beaa42b7af957e758c4 2023-02-08 13:03:15,913 INFO [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f2/56c038a914654beaa42b7af957e758c4, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 13:03:15,914 INFO [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for aee4ebd3b9018cffc4286106bbaa3d48 in 64ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:15,914 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-08 13:03:15,914 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for aee4ebd3b9018cffc4286106bbaa3d48: 2023-02-08 13:03:15,914 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.' region-info for snapshot=foo 2023-02-08 13:03:15,914 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:15,914 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f1/9bfeaa6741cd4aad86d3f2817f334c65] hfiles 2023-02-08 13:03:15,914 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f1/9bfeaa6741cd4aad86d3f2817f334c65 for snapshot=foo 2023-02-08 13:03:15,914 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f2/56c038a914654beaa42b7af957e758c4] hfiles 2023-02-08 13:03:15,914 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f2/56c038a914654beaa42b7af957e758c4 for snapshot=foo 2023-02-08 13:03:15,921 DEBUG [Listener at localhost/35425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:15,921 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:15,921 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:15,922 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. completed. 2023-02-08 13:03:15,922 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:15,922 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-08 13:03:15,922 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-08 13:03:15,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-08 13:03:15,922 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:03:15,922 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-08 13:03:15,923 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,46275,1675861393887' in zk 2023-02-08 13:03:15,923 DEBUG [Listener at localhost/35425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 13:03:15,924 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,924 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-08 13:03:15,924 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:15,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:15,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:15,924 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-08 13:03:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 13:03:15,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:15,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:15,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 13:03:15,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:15,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,46275,1675861393887': 2023-02-08 13:03:15,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46275,1675861393887' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-08 13:03:15,928 INFO [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-08 13:03:15,928 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:03:15,928 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:03:15,928 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-08 13:03:15,928 INFO [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 13:03:15,931 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,931 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,931 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:15,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,931 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:15,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,931 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:15,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:15,931 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:15,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:15,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:15,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:15,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:15,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:15,932 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 13:03:15,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:15,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 13:03:15,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:15,933 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:15,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,934 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:15,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 13:03:15,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:15,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,939 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,939 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:15,939 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-08 13:03:15,939 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:15,939 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:15,939 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:15,939 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-08 13:03:15,939 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-08 13:03:15,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:15,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-08 13:03:15,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:15,939 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:15,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:15,939 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:15,939 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:15,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:15,939 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 13:03:15,940 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:15,940 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 13:03:15,940 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 13:03:15,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:15,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:15,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:15,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:15,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.hbase-snapshot/.tmp/foo 2023-02-08 13:03:15,954 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-08 13:03:15,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.hbase-snapshot/.tmp/foo to hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.hbase-snapshot/foo 2023-02-08 13:03:16,003 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-08 13:03:16,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.hbase-snapshot/.tmp/foo 2023-02-08 13:03:16,003 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.hbase-snapshot/.tmp/foo 2023-02-08 13:03:16,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1675861395820Consolidate snapshot: foo at 1675861395939 (+119 ms)Loading Region manifests for foo at 1675861395939Writing data manifest for foo at 1675861395943 (+4 ms)Verifying snapshot: foo at 1675861395953 (+10 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1675861396003 (+50 ms) 2023-02-08 13:03:16,005 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-08 13:03:16,006 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 185 msec 2023-02-08 13:03:16,123 DEBUG [Listener at localhost/35425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:16,123 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:16,123 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:16,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-08 13:03:16,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 13:03:16,125 INFO [Listener at localhost/35425] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 13:03:16,125 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:16,125 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:16,130 INFO [Listener at localhost/35425] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 13:03:16,135 INFO [Listener at localhost/35425] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 13:03:16,174 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46275] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:16,262 INFO [Listener at localhost/35425] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 13:03:16,266 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:16,267 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:16,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 13:03:16,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,271 INFO [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-08 13:03:16,271 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:16,272 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-08 13:03:16,272 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-08 13:03:16,273 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,273 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,274 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,274 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:16,274 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:16,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:16,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:16,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:16,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:16,274 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,274 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:03:16,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:03:16,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:03:16,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,275 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,275 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,276 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-08 13:03:16,276 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-08 13:03:16,276 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:16,276 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:16,277 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-08 13:03:16,277 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-08 13:03:16,277 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-08 13:03:16,278 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44641,1675861393859' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-08 13:03:16,278 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 13:03:16,278 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 13:03:16,278 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:16,278 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. started... 2023-02-08 13:03:16,278 INFO [rs(jenkins-hbase4.apache.org,46275,1675861393887)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aee4ebd3b9018cffc4286106bbaa3d48 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-08 13:03:16,280 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,280 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,280 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:16,296 INFO [rs(jenkins-hbase4.apache.org,46275,1675861393887)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/.tmp/f1/25bafb3044d6479789175169e36faa6b 2023-02-08 13:03:16,315 INFO [rs(jenkins-hbase4.apache.org,46275,1675861393887)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/.tmp/f2/b7c04a0a67d24c65868dbd2fc529ff71 2023-02-08 13:03:16,320 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/.tmp/f1/25bafb3044d6479789175169e36faa6b as hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f1/25bafb3044d6479789175169e36faa6b 2023-02-08 13:03:16,324 INFO [rs(jenkins-hbase4.apache.org,46275,1675861393887)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f1/25bafb3044d6479789175169e36faa6b, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 13:03:16,325 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/.tmp/f2/b7c04a0a67d24c65868dbd2fc529ff71 as hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f2/b7c04a0a67d24c65868dbd2fc529ff71 2023-02-08 13:03:16,329 INFO [rs(jenkins-hbase4.apache.org,46275,1675861393887)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f2/b7c04a0a67d24c65868dbd2fc529ff71, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 13:03:16,329 INFO [rs(jenkins-hbase4.apache.org,46275,1675861393887)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for aee4ebd3b9018cffc4286106bbaa3d48 in 51ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:16,329 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aee4ebd3b9018cffc4286106bbaa3d48: 2023-02-08 13:03:16,329 DEBUG [rs(jenkins-hbase4.apache.org,46275,1675861393887)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:16,329 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 13:03:16,329 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 13:03:16,330 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,330 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-08 13:03:16,330 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46275,1675861393887' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-08 13:03:16,333 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,333 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:16,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:16,333 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,333 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:16,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:16,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:16,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:16,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:16,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46275,1675861393887' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-08 13:03:16,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5740b75c[Count = 0] remaining members to acquire global barrier 2023-02-08 13:03:16,334 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-08 13:03:16,335 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,335 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,336 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,336 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-08 13:03:16,336 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-08 13:03:16,336 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,336 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:03:16,336 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-08 13:03:16,336 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-08 13:03:16,336 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,44641,1675861393859' in zk 2023-02-08 13:03:16,336 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,46275,1675861393887' in zk 2023-02-08 13:03:16,337 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-08 13:03:16,337 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,337 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:16,337 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-08 13:03:16,338 DEBUG [member: 'jenkins-hbase4.apache.org,44641,1675861393859' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-08 13:03:16,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:16,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:16,338 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:16,339 DEBUG [member: 'jenkins-hbase4.apache.org,46275,1675861393887' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-08 13:03:16,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:16,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:16,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:16,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:16,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:16,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,46275,1675861393887': 2023-02-08 13:03:16,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46275,1675861393887' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-08 13:03:16,342 INFO [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-08 13:03:16,342 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:03:16,342 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:03:16,342 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,342 INFO [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 13:03:16,343 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,344 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:16,344 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,344 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:16,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,344 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:16,344 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:16,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:16,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:16,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,345 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:16,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:16,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,346 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:16,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:16,346 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:16,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,349 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:16,349 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:16,349 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:16,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:16,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-08 13:03:16,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 13:03:16,349 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:16,349 DEBUG [(jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:16,349 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:16,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:16,350 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:16,350 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:16,351 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:16,351 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,351 DEBUG [Listener at localhost/35425] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-08 13:03:16,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:16,351 DEBUG [Listener at localhost/35425] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 13:03:16,351 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,351 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:16,351 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,351 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,451 DEBUG [Listener at localhost/35425] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 13:03:16,451 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:16,451 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:16,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 13:03:16,458 INFO [Listener at localhost/35425] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675861395805 type: FLUSH version: 2 ttl: 0 2023-02-08 13:03:16,458 DEBUG [Listener at localhost/35425] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44459/user/jenkins/test-data/11238197-f3df-f265-22b2-976db3019ef2/foo/1d6798ec-44bc-4318-bf91-bbda5f3b3359/data/default/testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,459 INFO [Listener at localhost/35425] snapshot.RestoreSnapshotHelper(239): region to add: aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:16,459 INFO [Listener at localhost/35425] snapshot.RestoreSnapshotHelper(585): clone region=aee4ebd3b9018cffc4286106bbaa3d48 as aee4ebd3b9018cffc4286106bbaa3d48 in snapshot foo 2023-02-08 13:03:16,460 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => aee4ebd3b9018cffc4286106bbaa3d48, NAME => 'testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44459/user/jenkins/test-data/11238197-f3df-f265-22b2-976db3019ef2/foo/1d6798ec-44bc-4318-bf91-bbda5f3b3359 2023-02-08 13:03:16,471 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:16,471 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9bfeaa6741cd4aad86d3f2817f334c65 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,474 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 56c038a914654beaa42b7af957e758c4 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,476 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing aee4ebd3b9018cffc4286106bbaa3d48, disabling compactions & flushes 2023-02-08 13:03:16,476 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:16,476 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:16,476 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. after waiting 0 ms 2023-02-08 13:03:16,476 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:16,476 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:16,476 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for aee4ebd3b9018cffc4286106bbaa3d48: Waiting for close lock at 1675861396476Disabling compacts and flushes for region at 1675861396476Disabling writes for close at 1675861396476Writing region close event to WAL at 1675861396476Closed at 1675861396476 2023-02-08 13:03:16,476 INFO [Listener at localhost/35425] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675861395805 type: FLUSH version: 2 ttl: 0 2023-02-08 13:03:16,476 DEBUG [Listener at localhost/35425] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44459/user/jenkins/test-data/11238197-f3df-f265-22b2-976db3019ef2/foo/1d6798ec-44bc-4318-bf91-bbda5f3b3359 2023-02-08 13:03:16,476 DEBUG [Listener at localhost/35425] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44459/user/jenkins/test-data/11238197-f3df-f265-22b2-976db3019ef2/foo/1d6798ec-44bc-4318-bf91-bbda5f3b3359 2023-02-08 13:03:16,477 DEBUG [Listener at localhost/35425] util.CommonFSUtils(699): |-data/ 2023-02-08 13:03:16,477 DEBUG [Listener at localhost/35425] util.CommonFSUtils(699): |----default/ 2023-02-08 13:03:16,478 DEBUG [Listener at localhost/35425] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-08 13:03:16,478 DEBUG [Listener at localhost/35425] util.CommonFSUtils(699): |----------aee4ebd3b9018cffc4286106bbaa3d48/ 2023-02-08 13:03:16,479 DEBUG [Listener at localhost/35425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:16,479 DEBUG [Listener at localhost/35425] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:16,479 DEBUG [Listener at localhost/35425] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=aee4ebd3b9018cffc4286106bbaa3d48-9bfeaa6741cd4aad86d3f2817f334c65 2023-02-08 13:03:16,479 DEBUG [Listener at localhost/35425] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:16,479 DEBUG [Listener at localhost/35425] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=aee4ebd3b9018cffc4286106bbaa3d48-56c038a914654beaa42b7af957e758c4 2023-02-08 13:03:16,480 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:16,480 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:16,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-08 13:03:16,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-08 13:03:16,484 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:16,484 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:16,484 INFO [Listener at localhost/35425] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,488 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:16,488 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:16,488 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861396488"}]},"ts":"1675861396488"} 2023-02-08 13:03:16,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 13:03:16,490 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-08 13:03:16,491 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-08 13:03:16,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aee4ebd3b9018cffc4286106bbaa3d48, UNASSIGN}] 2023-02-08 13:03:16,494 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aee4ebd3b9018cffc4286106bbaa3d48, UNASSIGN 2023-02-08 13:03:16,494 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=aee4ebd3b9018cffc4286106bbaa3d48, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675861396494"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861396494"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861396494"}]},"ts":"1675861396494"} 2023-02-08 13:03:16,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure aee4ebd3b9018cffc4286106bbaa3d48, server=jenkins-hbase4.apache.org,46275,1675861393887}] 2023-02-08 13:03:16,589 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:16,589 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:16,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 13:03:16,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:16,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing aee4ebd3b9018cffc4286106bbaa3d48, disabling compactions & flushes 2023-02-08 13:03:16,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:16,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:16,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. after waiting 0 ms 2023-02-08 13:03:16,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:16,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:16,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48. 2023-02-08 13:03:16,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for aee4ebd3b9018cffc4286106bbaa3d48: Waiting for close lock at 1675861396648Running coprocessor pre-close hooks at 1675861396648Disabling compacts and flushes for region at 1675861396648Disabling writes for close at 1675861396649 (+1 ms)Writing region close event to WAL at 1675861396651 (+2 ms)Running coprocessor post-close hooks at 1675861396654 (+3 ms)Closed at 1675861396655 (+1 ms) 2023-02-08 13:03:16,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:16,657 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=aee4ebd3b9018cffc4286106bbaa3d48, regionState=CLOSED 2023-02-08 13:03:16,657 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675861396657"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861396657"}]},"ts":"1675861396657"} 2023-02-08 13:03:16,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-08 13:03:16,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure aee4ebd3b9018cffc4286106bbaa3d48, server=jenkins-hbase4.apache.org,46275,1675861393887 in 163 msec 2023-02-08 13:03:16,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-08 13:03:16,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aee4ebd3b9018cffc4286106bbaa3d48, UNASSIGN in 168 msec 2023-02-08 13:03:16,662 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861396662"}]},"ts":"1675861396662"} 2023-02-08 13:03:16,663 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-08 13:03:16,664 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-08 13:03:16,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 180 msec 2023-02-08 13:03:16,791 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:16,791 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:16,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 13:03:16,793 INFO [Listener at localhost/35425] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-08 13:03:16,793 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:16,793 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:16,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,795 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,796 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:16,796 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:16,796 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 13:03:16,799 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:16,801 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f1, FileablePath, hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f2, FileablePath, hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/recovered.edits] 2023-02-08 13:03:16,804 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f1/25bafb3044d6479789175169e36faa6b to hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/archive/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f1/25bafb3044d6479789175169e36faa6b 2023-02-08 13:03:16,805 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f1/9bfeaa6741cd4aad86d3f2817f334c65 to hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/archive/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f1/9bfeaa6741cd4aad86d3f2817f334c65 2023-02-08 13:03:16,808 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f2/56c038a914654beaa42b7af957e758c4 to hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/archive/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f2/56c038a914654beaa42b7af957e758c4 2023-02-08 13:03:16,809 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f2/b7c04a0a67d24c65868dbd2fc529ff71 to hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/archive/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/f2/b7c04a0a67d24c65868dbd2fc529ff71 2023-02-08 13:03:16,812 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/recovered.edits/12.seqid to hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/archive/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48/recovered.edits/12.seqid 2023-02-08 13:03:16,812 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aee4ebd3b9018cffc4286106bbaa3d48 2023-02-08 13:03:16,812 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-08 13:03:16,814 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,816 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-08 13:03:16,817 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-08 13:03:16,818 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,818 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-08 13:03:16,818 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861396818"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:16,820 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-08 13:03:16,820 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => aee4ebd3b9018cffc4286106bbaa3d48, NAME => 'testInitTableSnapshotMapperJobConfig,,1675861395030.aee4ebd3b9018cffc4286106bbaa3d48.', STARTKEY => '', ENDKEY => ''}] 2023-02-08 13:03:16,820 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-08 13:03:16,820 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675861396820"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:16,823 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-08 13:03:16,825 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-08 13:03:16,826 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 31 msec 2023-02-08 13:03:16,897 INFO [Listener at localhost/35425] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:16,897 INFO [Listener at localhost/35425] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:16,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 13:03:16,899 INFO [Listener at localhost/35425] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-08 13:03:16,899 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 13:03:16,899 INFO [Listener at localhost/35425] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 13:03:16,899 DEBUG [Listener at localhost/35425] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10a0070e to 127.0.0.1:64231 2023-02-08 13:03:16,899 DEBUG [Listener at localhost/35425] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:16,899 DEBUG [Listener at localhost/35425] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 13:03:16,899 DEBUG [Listener at localhost/35425] util.JVMClusterUtil(257): Found active master hash=290187071, stopped=false 2023-02-08 13:03:16,899 INFO [Listener at localhost/35425] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44459,1675861393807 2023-02-08 13:03:16,902 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:16,902 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:16,902 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:16,902 INFO [Listener at localhost/35425] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 13:03:16,902 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:16,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:16,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:16,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:16,904 DEBUG [Listener at localhost/35425] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x462d0483 to 127.0.0.1:64231 2023-02-08 13:03:16,904 DEBUG [Listener at localhost/35425] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:16,904 INFO [Listener at localhost/35425] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44641,1675861393859' ***** 2023-02-08 13:03:16,904 INFO [Listener at localhost/35425] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:16,904 INFO [Listener at localhost/35425] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46275,1675861393887' ***** 2023-02-08 13:03:16,904 INFO [Listener at localhost/35425] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:16,904 INFO [RS:1;jenkins-hbase4:46275] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:16,904 INFO [RS:1;jenkins-hbase4:46275] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:16,904 INFO [RS:1;jenkins-hbase4:46275] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:16,904 INFO [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(3304): Received CLOSE for ef8ccb8da4d3d11df2285cadee57481d 2023-02-08 13:03:16,905 INFO [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:16,904 INFO [RS:0;jenkins-hbase4:44641] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:16,906 DEBUG [RS:1;jenkins-hbase4:46275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58312236 to 127.0.0.1:64231 2023-02-08 13:03:16,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ef8ccb8da4d3d11df2285cadee57481d, disabling compactions & flushes 2023-02-08 13:03:16,904 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:16,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. 2023-02-08 13:03:16,906 DEBUG [RS:1;jenkins-hbase4:46275] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:16,906 INFO [RS:0;jenkins-hbase4:44641] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:16,906 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:16,907 INFO [RS:0;jenkins-hbase4:44641] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:16,907 INFO [RS:1;jenkins-hbase4:46275] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:16,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. 2023-02-08 13:03:16,908 INFO [RS:1;jenkins-hbase4:46275] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:16,908 INFO [RS:0;jenkins-hbase4:44641] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:16,908 INFO [RS:1;jenkins-hbase4:46275] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:16,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. after waiting 0 ms 2023-02-08 13:03:16,908 INFO [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 13:03:16,908 DEBUG [RS:0;jenkins-hbase4:44641] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18aa2cfb to 127.0.0.1:64231 2023-02-08 13:03:16,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. 2023-02-08 13:03:16,908 DEBUG [RS:0;jenkins-hbase4:44641] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:16,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing ef8ccb8da4d3d11df2285cadee57481d 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 13:03:16,908 INFO [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-08 13:03:16,908 INFO [RS:0;jenkins-hbase4:44641] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44641,1675861393859; all regions closed. 2023-02-08 13:03:16,909 DEBUG [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, ef8ccb8da4d3d11df2285cadee57481d=hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d.} 2023-02-08 13:03:16,909 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:03:16,909 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:03:16,909 DEBUG [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(1505): Waiting on 1588230740, ef8ccb8da4d3d11df2285cadee57481d 2023-02-08 13:03:16,909 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:03:16,909 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:03:16,909 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:03:16,909 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-08 13:03:16,915 DEBUG [RS:0;jenkins-hbase4:44641] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/oldWALs 2023-02-08 13:03:16,915 INFO [RS:0;jenkins-hbase4:44641] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44641%2C1675861393859:(num 1675861395194) 2023-02-08 13:03:16,915 DEBUG [RS:0;jenkins-hbase4:44641] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:16,915 INFO [RS:0;jenkins-hbase4:44641] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:16,915 INFO [RS:0;jenkins-hbase4:44641] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:16,915 INFO [RS:0;jenkins-hbase4:44641] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:16,915 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:16,915 INFO [RS:0;jenkins-hbase4:44641] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:16,915 INFO [RS:0;jenkins-hbase4:44641] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:16,916 INFO [RS:0;jenkins-hbase4:44641] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44641 2023-02-08 13:03:16,918 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:16,918 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44641,1675861393859 2023-02-08 13:03:16,918 ERROR [Listener at localhost/35425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7c3c047f rejected from java.util.concurrent.ThreadPoolExecutor@78038f20[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:16,918 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:16,918 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:16,920 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:16,920 ERROR [Listener at localhost/35425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10f5b4d0 rejected from java.util.concurrent.ThreadPoolExecutor@78038f20[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:16,921 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44641,1675861393859] 2023-02-08 13:03:16,921 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44641,1675861393859; numProcessing=1 2023-02-08 13:03:16,922 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44641,1675861393859 already deleted, retry=false 2023-02-08 13:03:16,922 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44641,1675861393859 expired; onlineServers=1 2023-02-08 13:03:16,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/namespace/ef8ccb8da4d3d11df2285cadee57481d/.tmp/info/0a80a65866244c0d9cadbba5ddda50f7 2023-02-08 13:03:16,924 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/.tmp/info/ea3ef46662ba4c7aa6825ffba69c364d 2023-02-08 13:03:16,928 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea3ef46662ba4c7aa6825ffba69c364d 2023-02-08 13:03:16,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/namespace/ef8ccb8da4d3d11df2285cadee57481d/.tmp/info/0a80a65866244c0d9cadbba5ddda50f7 as hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/namespace/ef8ccb8da4d3d11df2285cadee57481d/info/0a80a65866244c0d9cadbba5ddda50f7 2023-02-08 13:03:16,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/namespace/ef8ccb8da4d3d11df2285cadee57481d/info/0a80a65866244c0d9cadbba5ddda50f7, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 13:03:16,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ef8ccb8da4d3d11df2285cadee57481d in 26ms, sequenceid=6, compaction requested=false 2023-02-08 13:03:16,938 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/.tmp/rep_barrier/34b3fe1584cf44b2b3db98a4abcf120d 2023-02-08 13:03:16,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/namespace/ef8ccb8da4d3d11df2285cadee57481d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 13:03:16,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. 2023-02-08 13:03:16,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ef8ccb8da4d3d11df2285cadee57481d: Waiting for close lock at 1675861396905Running coprocessor pre-close hooks at 1675861396905Disabling compacts and flushes for region at 1675861396905Disabling writes for close at 1675861396908 (+3 ms)Obtaining lock to block concurrent updates at 1675861396909 (+1 ms)Preparing flush snapshotting stores in ef8ccb8da4d3d11df2285cadee57481d at 1675861396909Finished memstore snapshotting hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675861396909Flushing stores of hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. at 1675861396910 (+1 ms)Flushing ef8ccb8da4d3d11df2285cadee57481d/info: creating writer at 1675861396910Flushing ef8ccb8da4d3d11df2285cadee57481d/info: appending metadata at 1675861396915 (+5 ms)Flushing ef8ccb8da4d3d11df2285cadee57481d/info: closing flushed file at 1675861396915Flushing ef8ccb8da4d3d11df2285cadee57481d/info: reopening flushed file at 1675861396929 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ef8ccb8da4d3d11df2285cadee57481d in 26ms, sequenceid=6, compaction requested=false at 1675861396934 (+5 ms)Writing region close event to WAL at 1675861396936 (+2 ms)Running coprocessor post-close hooks at 1675861396939 (+3 ms)Closed at 1675861396940 (+1 ms) 2023-02-08 13:03:16,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675861394471.ef8ccb8da4d3d11df2285cadee57481d. 2023-02-08 13:03:16,943 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34b3fe1584cf44b2b3db98a4abcf120d 2023-02-08 13:03:16,950 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/.tmp/table/5c081728e349445087bfd048fa95e9d5 2023-02-08 13:03:16,954 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c081728e349445087bfd048fa95e9d5 2023-02-08 13:03:16,955 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/.tmp/info/ea3ef46662ba4c7aa6825ffba69c364d as hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/info/ea3ef46662ba4c7aa6825ffba69c364d 2023-02-08 13:03:16,959 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea3ef46662ba4c7aa6825ffba69c364d 2023-02-08 13:03:16,959 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/info/ea3ef46662ba4c7aa6825ffba69c364d, entries=12, sequenceid=21, filesize=6.3 K 2023-02-08 13:03:16,960 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/.tmp/rep_barrier/34b3fe1584cf44b2b3db98a4abcf120d as hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/rep_barrier/34b3fe1584cf44b2b3db98a4abcf120d 2023-02-08 13:03:16,964 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34b3fe1584cf44b2b3db98a4abcf120d 2023-02-08 13:03:16,964 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/rep_barrier/34b3fe1584cf44b2b3db98a4abcf120d, entries=1, sequenceid=21, filesize=5.0 K 2023-02-08 13:03:16,965 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/.tmp/table/5c081728e349445087bfd048fa95e9d5 as hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/table/5c081728e349445087bfd048fa95e9d5 2023-02-08 13:03:16,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c081728e349445087bfd048fa95e9d5 2023-02-08 13:03:16,969 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:16,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/table/5c081728e349445087bfd048fa95e9d5, entries=4, sequenceid=21, filesize=5.1 K 2023-02-08 13:03:16,971 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 62ms, sequenceid=21, compaction requested=false 2023-02-08 13:03:16,971 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-08 13:03:16,974 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:16,975 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-08 13:03:16,976 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 13:03:16,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:16,977 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861396909Running coprocessor pre-close hooks at 1675861396909Disabling compacts and flushes for region at 1675861396909Disabling writes for close at 1675861396909Obtaining lock to block concurrent updates at 1675861396909Preparing flush snapshotting stores in 1588230740 at 1675861396909Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1675861396910 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675861396911 (+1 ms)Flushing 1588230740/info: creating writer at 1675861396911Flushing 1588230740/info: appending metadata at 1675861396915 (+4 ms)Flushing 1588230740/info: closing flushed file at 1675861396915Flushing 1588230740/rep_barrier: creating writer at 1675861396928 (+13 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675861396930 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675861396930Flushing 1588230740/table: creating writer at 1675861396943 (+13 ms)Flushing 1588230740/table: appending metadata at 1675861396945 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675861396945Flushing 1588230740/info: reopening flushed file at 1675861396955 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675861396960 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675861396965 (+5 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 62ms, sequenceid=21, compaction requested=false at 1675861396971 (+6 ms)Writing region close event to WAL at 1675861396972 (+1 ms)Running coprocessor post-close hooks at 1675861396976 (+4 ms)Closed at 1675861396976 2023-02-08 13:03:16,977 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:17,102 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:17,102 INFO [RS:0;jenkins-hbase4:44641] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44641,1675861393859; zookeeper connection closed. 2023-02-08 13:03:17,102 ERROR [Listener at localhost/35425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6868b16c rejected from java.util.concurrent.ThreadPoolExecutor@78038f20[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:17,102 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:44641-0x10034076b420001, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:17,102 ERROR [Listener at localhost/35425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60c08d4a rejected from java.util.concurrent.ThreadPoolExecutor@78038f20[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:17,102 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@31dd3f2f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@31dd3f2f 2023-02-08 13:03:17,109 INFO [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46275,1675861393887; all regions closed. 2023-02-08 13:03:17,115 DEBUG [RS:1;jenkins-hbase4:46275] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/oldWALs 2023-02-08 13:03:17,115 INFO [RS:1;jenkins-hbase4:46275] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46275%2C1675861393887.meta:.meta(num 1675861394418) 2023-02-08 13:03:17,120 DEBUG [RS:1;jenkins-hbase4:46275] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/oldWALs 2023-02-08 13:03:17,120 INFO [RS:1;jenkins-hbase4:46275] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46275%2C1675861393887:(num 1675861394827) 2023-02-08 13:03:17,120 DEBUG [RS:1;jenkins-hbase4:46275] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:17,120 INFO [RS:1;jenkins-hbase4:46275] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:17,120 INFO [RS:1;jenkins-hbase4:46275] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:17,120 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:17,121 INFO [RS:1;jenkins-hbase4:46275] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46275 2023-02-08 13:03:17,124 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46275,1675861393887 2023-02-08 13:03:17,124 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:17,124 ERROR [Listener at localhost/35425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@20348505 rejected from java.util.concurrent.ThreadPoolExecutor@240b05db[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:17,125 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46275,1675861393887] 2023-02-08 13:03:17,125 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46275,1675861393887; numProcessing=2 2023-02-08 13:03:17,126 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46275,1675861393887 already deleted, retry=false 2023-02-08 13:03:17,126 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46275,1675861393887 expired; onlineServers=0 2023-02-08 13:03:17,126 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44459,1675861393807' ***** 2023-02-08 13:03:17,126 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 13:03:17,126 DEBUG [M:0;jenkins-hbase4:44459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@157471ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:17,126 INFO [M:0;jenkins-hbase4:44459] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44459,1675861393807 2023-02-08 13:03:17,126 INFO [M:0;jenkins-hbase4:44459] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44459,1675861393807; all regions closed. 2023-02-08 13:03:17,126 DEBUG [M:0;jenkins-hbase4:44459] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:17,127 DEBUG [M:0;jenkins-hbase4:44459] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 13:03:17,127 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 13:03:17,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861394055] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861394055,5,FailOnTimeoutGroup] 2023-02-08 13:03:17,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861394054] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861394054,5,FailOnTimeoutGroup] 2023-02-08 13:03:17,127 DEBUG [M:0;jenkins-hbase4:44459] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 13:03:17,128 INFO [M:0;jenkins-hbase4:44459] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 13:03:17,128 INFO [M:0;jenkins-hbase4:44459] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 13:03:17,129 INFO [M:0;jenkins-hbase4:44459] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 13:03:17,129 DEBUG [M:0;jenkins-hbase4:44459] master.HMaster(1502): Stopping service threads 2023-02-08 13:03:17,129 INFO [M:0;jenkins-hbase4:44459] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 13:03:17,129 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:17,129 ERROR [M:0;jenkins-hbase4:44459] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-08 13:03:17,129 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:17,130 INFO [M:0;jenkins-hbase4:44459] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 13:03:17,130 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 13:03:17,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:17,130 DEBUG [M:0;jenkins-hbase4:44459] zookeeper.ZKUtil(398): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 13:03:17,130 WARN [M:0;jenkins-hbase4:44459] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 13:03:17,130 INFO [M:0;jenkins-hbase4:44459] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 13:03:17,131 INFO [M:0;jenkins-hbase4:44459] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 13:03:17,131 DEBUG [M:0;jenkins-hbase4:44459] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:03:17,131 INFO [M:0;jenkins-hbase4:44459] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:17,131 DEBUG [M:0;jenkins-hbase4:44459] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:17,131 DEBUG [M:0;jenkins-hbase4:44459] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:03:17,131 DEBUG [M:0;jenkins-hbase4:44459] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:17,131 INFO [M:0;jenkins-hbase4:44459] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.89 KB heapSize=66.83 KB 2023-02-08 13:03:17,142 INFO [M:0;jenkins-hbase4:44459] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.89 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8a34ea2ee957462786282772b0d87754 2023-02-08 13:03:17,146 DEBUG [M:0;jenkins-hbase4:44459] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8a34ea2ee957462786282772b0d87754 as hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8a34ea2ee957462786282772b0d87754 2023-02-08 13:03:17,150 INFO [M:0;jenkins-hbase4:44459] regionserver.HStore(1080): Added hdfs://localhost:44459/user/jenkins/test-data/b8a4461b-d033-cbc2-86b9-024ade9e4c34/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8a34ea2ee957462786282772b0d87754, entries=17, sequenceid=132, filesize=8.7 K 2023-02-08 13:03:17,151 INFO [M:0;jenkins-hbase4:44459] regionserver.HRegion(2947): Finished flush of dataSize ~55.89 KB/57229, heapSize ~66.81 KB/68416, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=132, compaction requested=false 2023-02-08 13:03:17,151 INFO [M:0;jenkins-hbase4:44459] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:17,151 DEBUG [M:0;jenkins-hbase4:44459] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861397131Disabling compacts and flushes for region at 1675861397131Disabling writes for close at 1675861397131Obtaining lock to block concurrent updates at 1675861397131Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675861397131Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57229, getHeapSize=68416, getOffHeapSize=0, getCellsCount=145 at 1675861397132 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675861397132Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675861397133 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675861397135 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675861397135Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675861397147 (+12 ms)Finished flush of dataSize ~55.89 KB/57229, heapSize ~66.81 KB/68416, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=132, compaction requested=false at 1675861397151 (+4 ms)Writing region close event to WAL at 1675861397151Closed at 1675861397151 2023-02-08 13:03:17,154 INFO [M:0;jenkins-hbase4:44459] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 13:03:17,154 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:17,155 INFO [M:0;jenkins-hbase4:44459] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44459 2023-02-08 13:03:17,158 DEBUG [M:0;jenkins-hbase4:44459] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44459,1675861393807 already deleted, retry=false 2023-02-08 13:03:17,503 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:17,503 INFO [M:0;jenkins-hbase4:44459] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44459,1675861393807; zookeeper connection closed. 2023-02-08 13:03:17,503 ERROR [Listener at localhost/35425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@452e547e rejected from java.util.concurrent.ThreadPoolExecutor@4111d803[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:17,504 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): master:44459-0x10034076b420000, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:17,504 ERROR [Listener at localhost/35425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e7079f rejected from java.util.concurrent.ThreadPoolExecutor@4111d803[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:17,603 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:17,603 INFO [RS:1;jenkins-hbase4:46275] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46275,1675861393887; zookeeper connection closed. 2023-02-08 13:03:17,603 ERROR [Listener at localhost/35425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@54ba3382 rejected from java.util.concurrent.ThreadPoolExecutor@240b05db[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:17,603 DEBUG [Listener at localhost/35425-EventThread] zookeeper.ZKWatcher(600): regionserver:46275-0x10034076b420002, quorum=127.0.0.1:64231, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:17,603 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6a5d0b86] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6a5d0b86 2023-02-08 13:03:17,603 ERROR [Listener at localhost/35425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2c7b6abf rejected from java.util.concurrent.ThreadPoolExecutor@240b05db[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:17,603 INFO [Listener at localhost/35425] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 13:03:17,604 WARN [Listener at localhost/35425] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:17,608 INFO [Listener at localhost/35425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:17,712 WARN [BP-1927700418-172.31.14.131-1675861393196 heartbeating to localhost/127.0.0.1:44459] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:17,712 WARN [BP-1927700418-172.31.14.131-1675861393196 heartbeating to localhost/127.0.0.1:44459] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1927700418-172.31.14.131-1675861393196 (Datanode Uuid a0f8804b-abc0-41b7-a738-a4c775a95e56) service to localhost/127.0.0.1:44459 2023-02-08 13:03:17,713 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/cluster_7028dd61-03f9-e7cc-4bf7-aec869669eb8/dfs/data/data3/current/BP-1927700418-172.31.14.131-1675861393196] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:17,713 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/cluster_7028dd61-03f9-e7cc-4bf7-aec869669eb8/dfs/data/data4/current/BP-1927700418-172.31.14.131-1675861393196] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:17,714 WARN [Listener at localhost/35425] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:17,720 INFO [Listener at localhost/35425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:17,825 WARN [BP-1927700418-172.31.14.131-1675861393196 heartbeating to localhost/127.0.0.1:44459] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:17,825 WARN [BP-1927700418-172.31.14.131-1675861393196 heartbeating to localhost/127.0.0.1:44459] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1927700418-172.31.14.131-1675861393196 (Datanode Uuid a9aab93e-d855-48ae-9a0a-b4460f12781f) service to localhost/127.0.0.1:44459 2023-02-08 13:03:17,826 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/cluster_7028dd61-03f9-e7cc-4bf7-aec869669eb8/dfs/data/data1/current/BP-1927700418-172.31.14.131-1675861393196] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:17,826 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/cluster_7028dd61-03f9-e7cc-4bf7-aec869669eb8/dfs/data/data2/current/BP-1927700418-172.31.14.131-1675861393196] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:17,837 INFO [Listener at localhost/35425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:17,972 INFO [Listener at localhost/35425] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 13:03:18,011 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 13:03:18,027 INFO [Listener at localhost/35425] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=178 (was 155) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:44459 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35425 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44459 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44459,1675861393807)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:44459 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:44459 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:44459 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:44459 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:44459 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=571 (was 534) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=310 (was 329), ProcessCount=165 (was 165), AvailableMemoryMB=4082 (was 4107) 2023-02-08 13:03:18,038 INFO [Listener at localhost/35425] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=178, OpenFileDescriptor=571, MaxFileDescriptor=60000, SystemLoadAverage=310, ProcessCount=165, AvailableMemoryMB=4082 2023-02-08 13:03:18,049 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/hadoop.log.dir so I do NOT create it in target/test-data/ee666185-c475-5e24-38ce-98f6581844f5 2023-02-08 13:03:18,049 WARN [Listener at localhost/35425] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/hadoop.log.dir Erasing configuration value by system value. 2023-02-08 13:03:18,049 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/hadoop.tmp.dir so I do NOT create it in target/test-data/ee666185-c475-5e24-38ce-98f6581844f5 2023-02-08 13:03:18,049 WARN [Listener at localhost/35425] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f855852-7771-b6c5-f31e-1ba2ea7738ee/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-08 13:03:18,049 DEBUG [Listener at localhost/35425] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5 2023-02-08 13:03:18,049 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 13:03:18,049 INFO [Listener at localhost/35425] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/cluster_9693065a-f2aa-7f1f-de25-8aa5b9c2e8e8, deleteOnExit=true 2023-02-08 13:03:18,049 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 13:03:18,049 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/test.cache.data in system properties and HBase conf 2023-02-08 13:03:18,049 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 13:03:18,050 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/hadoop.log.dir in system properties and HBase conf 2023-02-08 13:03:18,050 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 13:03:18,050 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 13:03:18,050 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 13:03:18,050 DEBUG [Listener at localhost/35425] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 13:03:18,050 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:03:18,050 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:03:18,050 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 13:03:18,050 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:03:18,050 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 13:03:18,051 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 13:03:18,051 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:03:18,051 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:03:18,051 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 13:03:18,051 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/nfs.dump.dir in system properties and HBase conf 2023-02-08 13:03:18,051 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/java.io.tmpdir in system properties and HBase conf 2023-02-08 13:03:18,051 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:03:18,051 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 13:03:18,051 INFO [Listener at localhost/35425] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 13:03:18,055 WARN [Listener at localhost/35425] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:03:18,055 WARN [Listener at localhost/35425] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:03:18,093 WARN [Listener at localhost/35425] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:18,094 INFO [Listener at localhost/35425] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:18,099 INFO [Listener at localhost/35425] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/java.io.tmpdir/Jetty_localhost_40505_hdfs____umk148/webapp 2023-02-08 13:03:18,193 INFO [Listener at localhost/35425] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40505 2023-02-08 13:03:18,197 WARN [Listener at localhost/35425] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:03:18,197 WARN [Listener at localhost/35425] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:03:18,243 WARN [Listener at localhost/36581] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:18,257 WARN [Listener at localhost/36581] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:03:18,259 WARN [Listener at localhost/36581] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:18,260 INFO [Listener at localhost/36581] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:18,265 INFO [Listener at localhost/36581] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/java.io.tmpdir/Jetty_localhost_43147_datanode____gd1i4c/webapp 2023-02-08 13:03:18,355 INFO [Listener at localhost/36581] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43147 2023-02-08 13:03:18,364 WARN [Listener at localhost/45345] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:18,378 WARN [Listener at localhost/45345] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:03:18,380 WARN [Listener at localhost/45345] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:18,381 INFO [Listener at localhost/45345] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:18,384 INFO [Listener at localhost/45345] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/java.io.tmpdir/Jetty_localhost_45521_datanode____2z88sa/webapp 2023-02-08 13:03:18,457 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5a8aec8e72d6cd27: Processing first storage report for DS-6f26e067-d6c4-4af8-82af-f01fa4ac93c3 from datanode 1ae7b4dc-d727-45b9-b610-dc14b391a530 2023-02-08 13:03:18,457 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5a8aec8e72d6cd27: from storage DS-6f26e067-d6c4-4af8-82af-f01fa4ac93c3 node DatanodeRegistration(127.0.0.1:38853, datanodeUuid=1ae7b4dc-d727-45b9-b610-dc14b391a530, infoPort=37209, infoSecurePort=0, ipcPort=45345, storageInfo=lv=-57;cid=testClusterID;nsid=1293890462;c=1675861398058), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:18,457 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5a8aec8e72d6cd27: Processing first storage report for DS-05fee438-c6b8-4919-8bd8-14c1676b08d1 from datanode 1ae7b4dc-d727-45b9-b610-dc14b391a530 2023-02-08 13:03:18,457 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5a8aec8e72d6cd27: from storage DS-05fee438-c6b8-4919-8bd8-14c1676b08d1 node DatanodeRegistration(127.0.0.1:38853, datanodeUuid=1ae7b4dc-d727-45b9-b610-dc14b391a530, infoPort=37209, infoSecurePort=0, ipcPort=45345, storageInfo=lv=-57;cid=testClusterID;nsid=1293890462;c=1675861398058), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:18,485 INFO [Listener at localhost/45345] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45521 2023-02-08 13:03:18,493 WARN [Listener at localhost/33639] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:18,578 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x22f638e19c133233: Processing first storage report for DS-e3557842-6791-4ec3-9fdd-19be96dfe0eb from datanode b5d265a7-cc9e-41b3-a9b5-a900178ee2ee 2023-02-08 13:03:18,579 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x22f638e19c133233: from storage DS-e3557842-6791-4ec3-9fdd-19be96dfe0eb node DatanodeRegistration(127.0.0.1:36045, datanodeUuid=b5d265a7-cc9e-41b3-a9b5-a900178ee2ee, infoPort=37287, infoSecurePort=0, ipcPort=33639, storageInfo=lv=-57;cid=testClusterID;nsid=1293890462;c=1675861398058), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-08 13:03:18,579 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x22f638e19c133233: Processing first storage report for DS-de4abbf8-2326-441c-8c25-5d8a952c6ea1 from datanode b5d265a7-cc9e-41b3-a9b5-a900178ee2ee 2023-02-08 13:03:18,579 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x22f638e19c133233: from storage DS-de4abbf8-2326-441c-8c25-5d8a952c6ea1 node DatanodeRegistration(127.0.0.1:36045, datanodeUuid=b5d265a7-cc9e-41b3-a9b5-a900178ee2ee, infoPort=37287, infoSecurePort=0, ipcPort=33639, storageInfo=lv=-57;cid=testClusterID;nsid=1293890462;c=1675861398058), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:18,603 DEBUG [Listener at localhost/33639] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5 2023-02-08 13:03:18,605 INFO [Listener at localhost/33639] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/cluster_9693065a-f2aa-7f1f-de25-8aa5b9c2e8e8/zookeeper_0, clientPort=51700, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/cluster_9693065a-f2aa-7f1f-de25-8aa5b9c2e8e8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/cluster_9693065a-f2aa-7f1f-de25-8aa5b9c2e8e8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 13:03:18,606 INFO [Listener at localhost/33639] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51700 2023-02-08 13:03:18,606 INFO [Listener at localhost/33639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:18,607 INFO [Listener at localhost/33639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:18,620 INFO [Listener at localhost/33639] util.FSUtils(479): Created version file at hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47 with version=8 2023-02-08 13:03:18,620 INFO [Listener at localhost/33639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:18,621 INFO [Listener at localhost/33639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:18,622 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/hbase-staging 2023-02-08 13:03:18,624 INFO [Listener at localhost/33639] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:18,624 INFO [Listener at localhost/33639] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:18,624 INFO [Listener at localhost/33639] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:18,624 INFO [Listener at localhost/33639] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:18,624 INFO [Listener at localhost/33639] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:18,624 INFO [Listener at localhost/33639] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:18,625 INFO [Listener at localhost/33639] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:18,625 INFO [Listener at localhost/33639] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44573 2023-02-08 13:03:18,626 INFO [Listener at localhost/33639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:18,626 INFO [Listener at localhost/33639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:18,627 INFO [Listener at localhost/33639] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44573 connecting to ZooKeeper ensemble=127.0.0.1:51700 2023-02-08 13:03:18,634 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:445730x0, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:18,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44573-0x10034077e110000 connected 2023-02-08 13:03:18,653 DEBUG [Listener at localhost/33639] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:18,653 DEBUG [Listener at localhost/33639] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:18,654 DEBUG [Listener at localhost/33639] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:18,656 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44573 2023-02-08 13:03:18,656 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44573 2023-02-08 13:03:18,658 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44573 2023-02-08 13:03:18,660 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44573 2023-02-08 13:03:18,660 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44573 2023-02-08 13:03:18,660 INFO [Listener at localhost/33639] master.HMaster(439): hbase.rootdir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47, hbase.cluster.distributed=false 2023-02-08 13:03:18,672 INFO [Listener at localhost/33639] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:18,672 INFO [Listener at localhost/33639] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:18,672 INFO [Listener at localhost/33639] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:18,672 INFO [Listener at localhost/33639] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:18,672 INFO [Listener at localhost/33639] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:18,672 INFO [Listener at localhost/33639] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:18,673 INFO [Listener at localhost/33639] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:18,673 INFO [Listener at localhost/33639] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43751 2023-02-08 13:03:18,673 INFO [Listener at localhost/33639] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:03:18,677 DEBUG [Listener at localhost/33639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:18,677 INFO [Listener at localhost/33639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:18,679 INFO [Listener at localhost/33639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:18,680 INFO [Listener at localhost/33639] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43751 connecting to ZooKeeper ensemble=127.0.0.1:51700 2023-02-08 13:03:18,683 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:437510x0, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:18,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43751-0x10034077e110001 connected 2023-02-08 13:03:18,684 DEBUG [Listener at localhost/33639] zookeeper.ZKUtil(164): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:18,685 DEBUG [Listener at localhost/33639] zookeeper.ZKUtil(164): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:18,685 DEBUG [Listener at localhost/33639] zookeeper.ZKUtil(164): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:18,688 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43751 2023-02-08 13:03:18,688 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43751 2023-02-08 13:03:18,689 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43751 2023-02-08 13:03:18,690 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43751 2023-02-08 13:03:18,691 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43751 2023-02-08 13:03:18,702 INFO [Listener at localhost/33639] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:18,702 INFO [Listener at localhost/33639] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:18,702 INFO [Listener at localhost/33639] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:18,702 INFO [Listener at localhost/33639] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:18,702 INFO [Listener at localhost/33639] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:18,702 INFO [Listener at localhost/33639] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:18,702 INFO [Listener at localhost/33639] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:18,704 INFO [Listener at localhost/33639] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40069 2023-02-08 13:03:18,704 INFO [Listener at localhost/33639] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:03:18,705 DEBUG [Listener at localhost/33639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:18,706 INFO [Listener at localhost/33639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:18,707 INFO [Listener at localhost/33639] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:18,707 INFO [Listener at localhost/33639] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40069 connecting to ZooKeeper ensemble=127.0.0.1:51700 2023-02-08 13:03:18,710 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:400690x0, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:18,711 DEBUG [Listener at localhost/33639] zookeeper.ZKUtil(164): regionserver:400690x0, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:18,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40069-0x10034077e110002 connected 2023-02-08 13:03:18,712 DEBUG [Listener at localhost/33639] zookeeper.ZKUtil(164): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:18,713 DEBUG [Listener at localhost/33639] zookeeper.ZKUtil(164): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:18,716 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40069 2023-02-08 13:03:18,716 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40069 2023-02-08 13:03:18,716 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40069 2023-02-08 13:03:18,717 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40069 2023-02-08 13:03:18,718 DEBUG [Listener at localhost/33639] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40069 2023-02-08 13:03:18,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44573,1675861398623 2023-02-08 13:03:18,722 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:03:18,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44573,1675861398623 2023-02-08 13:03:18,724 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:18,724 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:18,724 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:18,724 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:18,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:03:18,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44573,1675861398623 from backup master directory 2023-02-08 13:03:18,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:03:18,727 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44573,1675861398623 2023-02-08 13:03:18,727 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:03:18,727 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:18,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,44573,1675861398623 2023-02-08 13:03:18,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/hbase.id with ID: 15c5a965-f929-474b-a3bc-8046f02d8ee3 2023-02-08 13:03:18,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:18,757 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:18,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x338ef415 to 127.0.0.1:51700 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:18,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4328ad15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:18,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:18,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 13:03:18,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:18,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/MasterData/data/master/store-tmp 2023-02-08 13:03:18,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:18,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:03:18,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:18,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:18,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:03:18,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:18,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:18,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861398780Disabling compacts and flushes for region at 1675861398780Disabling writes for close at 1675861398780Writing region close event to WAL at 1675861398780Closed at 1675861398780 2023-02-08 13:03:18,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/MasterData/WALs/jenkins-hbase4.apache.org,44573,1675861398623 2023-02-08 13:03:18,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44573%2C1675861398623, suffix=, logDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/MasterData/WALs/jenkins-hbase4.apache.org,44573,1675861398623, archiveDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/MasterData/oldWALs, maxLogs=10 2023-02-08 13:03:18,803 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36045,DS-e3557842-6791-4ec3-9fdd-19be96dfe0eb,DISK] 2023-02-08 13:03:18,803 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38853,DS-6f26e067-d6c4-4af8-82af-f01fa4ac93c3,DISK] 2023-02-08 13:03:18,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/MasterData/WALs/jenkins-hbase4.apache.org,44573,1675861398623/jenkins-hbase4.apache.org%2C44573%2C1675861398623.1675861398784 2023-02-08 13:03:18,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36045,DS-e3557842-6791-4ec3-9fdd-19be96dfe0eb,DISK], DatanodeInfoWithStorage[127.0.0.1:38853,DS-6f26e067-d6c4-4af8-82af-f01fa4ac93c3,DISK]] 2023-02-08 13:03:18,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:18,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:18,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:18,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:18,808 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:18,810 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 13:03:18,810 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 13:03:18,810 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:18,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:18,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:18,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:18,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:18,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66488070, jitterRate=-0.009250551462173462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:03:18,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675861398807Initializing all the Stores at 1675861398808 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861398808Cleaning up temporary data from old regions at 1675861398812 (+4 ms)Cleaning up detritus from prior splits at 1675861398812Region opened successfully at 1675861398816 (+4 ms) 2023-02-08 13:03:18,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 13:03:18,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 13:03:18,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 13:03:18,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 13:03:18,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-08 13:03:18,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-08 13:03:18,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 13:03:18,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 13:03:18,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 13:03:18,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 13:03:18,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 13:03:18,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 13:03:18,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 13:03:18,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 13:03:18,838 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:18,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 13:03:18,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 13:03:18,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 13:03:18,840 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:18,840 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:18,840 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:18,840 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:18,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,44573,1675861398623, sessionid=0x10034077e110000, setting cluster-up flag (Was=false) 2023-02-08 13:03:18,845 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:18,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 13:03:18,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44573,1675861398623 2023-02-08 13:03:18,852 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:18,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 13:03:18,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44573,1675861398623 2023-02-08 13:03:18,858 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.hbase-snapshot/.tmp 2023-02-08 13:03:18,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:18,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:18,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:18,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:18,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:18,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 13:03:18,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:18,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:18,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:18,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675861428867 2023-02-08 13:03:18,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 13:03:18,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 13:03:18,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 13:03:18,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 13:03:18,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 13:03:18,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 13:03:18,868 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:18,868 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 13:03:18,869 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:18,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:18,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 13:03:18,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 13:03:18,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 13:03:18,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 13:03:18,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 13:03:18,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861398874,5,FailOnTimeoutGroup] 2023-02-08 13:03:18,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861398878,5,FailOnTimeoutGroup] 2023-02-08 13:03:18,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:18,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 13:03:18,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:18,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:18,884 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:18,885 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:18,885 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47 2023-02-08 13:03:18,900 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:18,901 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:03:18,903 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/info 2023-02-08 13:03:18,903 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:03:18,903 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:18,904 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:03:18,905 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:18,905 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:03:18,906 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:18,906 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:03:18,907 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/table 2023-02-08 13:03:18,907 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:03:18,908 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:18,909 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740 2023-02-08 13:03:18,909 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740 2023-02-08 13:03:18,911 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:03:18,912 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:03:18,914 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:18,915 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69033800, jitterRate=0.028683781623840332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:03:18,915 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675861398900Initializing all the Stores at 1675861398901 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861398901Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861398901Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861398901Cleaning up temporary data from old regions at 1675861398910 (+9 ms)Cleaning up detritus from prior splits at 1675861398910Region opened successfully at 1675861398915 (+5 ms) 2023-02-08 13:03:18,915 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:03:18,915 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:03:18,915 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:03:18,915 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:03:18,915 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:03:18,915 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:18,915 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861398915Disabling compacts and flushes for region at 1675861398915Disabling writes for close at 1675861398915Writing region close event to WAL at 1675861398915Closed at 1675861398915 2023-02-08 13:03:18,916 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:18,916 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 13:03:18,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 13:03:18,918 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 13:03:18,920 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 13:03:18,920 INFO [RS:1;jenkins-hbase4:40069] regionserver.HRegionServer(952): ClusterId : 15c5a965-f929-474b-a3bc-8046f02d8ee3 2023-02-08 13:03:18,920 INFO [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(952): ClusterId : 15c5a965-f929-474b-a3bc-8046f02d8ee3 2023-02-08 13:03:18,920 DEBUG [RS:1;jenkins-hbase4:40069] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:03:18,921 DEBUG [RS:0;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:03:18,923 DEBUG [RS:1;jenkins-hbase4:40069] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:03:18,923 DEBUG [RS:1;jenkins-hbase4:40069] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:03:18,923 DEBUG [RS:0;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:03:18,923 DEBUG [RS:0;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:03:18,925 DEBUG [RS:1;jenkins-hbase4:40069] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:03:18,927 DEBUG [RS:0;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:03:18,927 DEBUG [RS:1;jenkins-hbase4:40069] zookeeper.ReadOnlyZKClient(139): Connect 0x625a4763 to 127.0.0.1:51700 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:18,928 DEBUG [RS:0;jenkins-hbase4:43751] zookeeper.ReadOnlyZKClient(139): Connect 0x22d0d138 to 127.0.0.1:51700 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:18,936 DEBUG [RS:0;jenkins-hbase4:43751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c173b12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:18,936 DEBUG [RS:1;jenkins-hbase4:40069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c9da558, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:18,936 DEBUG [RS:0;jenkins-hbase4:43751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2828ba48, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:18,936 DEBUG [RS:1;jenkins-hbase4:40069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68a22c13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:18,950 DEBUG [RS:0;jenkins-hbase4:43751] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43751 2023-02-08 13:03:18,950 DEBUG [RS:1;jenkins-hbase4:40069] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40069 2023-02-08 13:03:18,950 INFO [RS:0;jenkins-hbase4:43751] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:03:18,950 INFO [RS:0;jenkins-hbase4:43751] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:03:18,950 INFO [RS:1;jenkins-hbase4:40069] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:03:18,950 INFO [RS:1;jenkins-hbase4:40069] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:03:18,950 DEBUG [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:03:18,950 DEBUG [RS:1;jenkins-hbase4:40069] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:03:18,951 INFO [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44573,1675861398623 with isa=jenkins-hbase4.apache.org/172.31.14.131:43751, startcode=1675861398672 2023-02-08 13:03:18,951 INFO [RS:1;jenkins-hbase4:40069] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44573,1675861398623 with isa=jenkins-hbase4.apache.org/172.31.14.131:40069, startcode=1675861398701 2023-02-08 13:03:18,952 DEBUG [RS:1;jenkins-hbase4:40069] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:03:18,952 DEBUG [RS:0;jenkins-hbase4:43751] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:03:18,954 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46191, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:03:18,954 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51843, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:03:18,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44573] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:18,955 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:18,956 DEBUG [RS:1;jenkins-hbase4:40069] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47 2023-02-08 13:03:18,956 DEBUG [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47 2023-02-08 13:03:18,956 DEBUG [RS:1;jenkins-hbase4:40069] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36581 2023-02-08 13:03:18,956 DEBUG [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36581 2023-02-08 13:03:18,956 DEBUG [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:03:18,956 DEBUG [RS:1;jenkins-hbase4:40069] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:03:18,961 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:18,962 DEBUG [RS:1;jenkins-hbase4:40069] zookeeper.ZKUtil(162): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:18,962 DEBUG [RS:0;jenkins-hbase4:43751] zookeeper.ZKUtil(162): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:18,962 WARN [RS:1;jenkins-hbase4:40069] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:18,962 WARN [RS:0;jenkins-hbase4:43751] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:18,962 INFO [RS:1;jenkins-hbase4:40069] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:18,962 INFO [RS:0;jenkins-hbase4:43751] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:18,962 DEBUG [RS:1;jenkins-hbase4:40069] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/WALs/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:18,962 DEBUG [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/WALs/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:18,963 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43751,1675861398672] 2023-02-08 13:03:18,963 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40069,1675861398701] 2023-02-08 13:03:18,968 DEBUG [RS:1;jenkins-hbase4:40069] zookeeper.ZKUtil(162): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:18,968 DEBUG [RS:0;jenkins-hbase4:43751] zookeeper.ZKUtil(162): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:18,969 DEBUG [RS:1;jenkins-hbase4:40069] zookeeper.ZKUtil(162): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:18,969 DEBUG [RS:0;jenkins-hbase4:43751] zookeeper.ZKUtil(162): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:18,970 DEBUG [RS:1;jenkins-hbase4:40069] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:03:18,970 DEBUG [RS:0;jenkins-hbase4:43751] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:03:18,970 INFO [RS:1;jenkins-hbase4:40069] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:03:18,970 INFO [RS:0;jenkins-hbase4:43751] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:03:18,971 INFO [RS:1;jenkins-hbase4:40069] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:03:19,008 INFO [RS:1;jenkins-hbase4:40069] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:03:19,008 INFO [RS:1;jenkins-hbase4:40069] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,011 INFO [RS:1;jenkins-hbase4:40069] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:03:19,011 INFO [RS:0;jenkins-hbase4:43751] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:03:19,013 INFO [RS:0;jenkins-hbase4:43751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:03:19,014 INFO [RS:0;jenkins-hbase4:43751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,014 INFO [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:03:19,014 INFO [RS:1;jenkins-hbase4:40069] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,015 DEBUG [RS:1;jenkins-hbase4:40069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,015 DEBUG [RS:1;jenkins-hbase4:40069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,015 DEBUG [RS:1;jenkins-hbase4:40069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,015 DEBUG [RS:1;jenkins-hbase4:40069] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,015 DEBUG [RS:1;jenkins-hbase4:40069] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,015 DEBUG [RS:1;jenkins-hbase4:40069] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:19,015 DEBUG [RS:1;jenkins-hbase4:40069] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,015 DEBUG [RS:1;jenkins-hbase4:40069] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,015 DEBUG [RS:1;jenkins-hbase4:40069] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,015 DEBUG [RS:1;jenkins-hbase4:40069] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,015 INFO [RS:0;jenkins-hbase4:43751] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,016 DEBUG [RS:0;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,016 DEBUG [RS:0;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,016 DEBUG [RS:0;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,017 INFO [RS:1;jenkins-hbase4:40069] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,018 DEBUG [RS:0;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,018 INFO [RS:1;jenkins-hbase4:40069] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,018 DEBUG [RS:0;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,018 INFO [RS:1;jenkins-hbase4:40069] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,018 DEBUG [RS:0;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:19,018 DEBUG [RS:0;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,018 DEBUG [RS:0;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,018 DEBUG [RS:0;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,018 DEBUG [RS:0;jenkins-hbase4:43751] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:19,028 INFO [RS:0;jenkins-hbase4:43751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,028 INFO [RS:0;jenkins-hbase4:43751] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,029 INFO [RS:0;jenkins-hbase4:43751] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,029 INFO [RS:1;jenkins-hbase4:40069] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:03:19,029 INFO [RS:1;jenkins-hbase4:40069] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40069,1675861398701-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,041 INFO [RS:1;jenkins-hbase4:40069] regionserver.Replication(203): jenkins-hbase4.apache.org,40069,1675861398701 started 2023-02-08 13:03:19,041 INFO [RS:1;jenkins-hbase4:40069] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40069,1675861398701, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40069, sessionid=0x10034077e110002 2023-02-08 13:03:19,041 DEBUG [RS:1;jenkins-hbase4:40069] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:03:19,042 DEBUG [RS:1;jenkins-hbase4:40069] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:19,042 DEBUG [RS:1;jenkins-hbase4:40069] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40069,1675861398701' 2023-02-08 13:03:19,042 DEBUG [RS:1;jenkins-hbase4:40069] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:19,042 DEBUG [RS:1;jenkins-hbase4:40069] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:19,042 DEBUG [RS:1;jenkins-hbase4:40069] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:03:19,042 DEBUG [RS:1;jenkins-hbase4:40069] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:03:19,042 DEBUG [RS:1;jenkins-hbase4:40069] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:19,042 DEBUG [RS:1;jenkins-hbase4:40069] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40069,1675861398701' 2023-02-08 13:03:19,042 DEBUG [RS:1;jenkins-hbase4:40069] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:19,043 DEBUG [RS:1;jenkins-hbase4:40069] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:19,043 DEBUG [RS:1;jenkins-hbase4:40069] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:03:19,043 INFO [RS:1;jenkins-hbase4:40069] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:03:19,043 INFO [RS:1;jenkins-hbase4:40069] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:03:19,044 INFO [RS:0;jenkins-hbase4:43751] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:03:19,044 INFO [RS:0;jenkins-hbase4:43751] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43751,1675861398672-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,057 INFO [RS:0;jenkins-hbase4:43751] regionserver.Replication(203): jenkins-hbase4.apache.org,43751,1675861398672 started 2023-02-08 13:03:19,057 INFO [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43751,1675861398672, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43751, sessionid=0x10034077e110001 2023-02-08 13:03:19,057 DEBUG [RS:0;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:03:19,057 DEBUG [RS:0;jenkins-hbase4:43751] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:19,058 DEBUG [RS:0;jenkins-hbase4:43751] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43751,1675861398672' 2023-02-08 13:03:19,058 DEBUG [RS:0;jenkins-hbase4:43751] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:19,058 DEBUG [RS:0;jenkins-hbase4:43751] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:19,058 DEBUG [RS:0;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:03:19,058 DEBUG [RS:0;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:03:19,058 DEBUG [RS:0;jenkins-hbase4:43751] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:19,058 DEBUG [RS:0;jenkins-hbase4:43751] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43751,1675861398672' 2023-02-08 13:03:19,059 DEBUG [RS:0;jenkins-hbase4:43751] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:19,059 DEBUG [RS:0;jenkins-hbase4:43751] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:19,059 DEBUG [RS:0;jenkins-hbase4:43751] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:03:19,059 INFO [RS:0;jenkins-hbase4:43751] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:03:19,059 INFO [RS:0;jenkins-hbase4:43751] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:03:19,070 DEBUG [jenkins-hbase4:44573] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 13:03:19,070 DEBUG [jenkins-hbase4:44573] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:19,072 DEBUG [jenkins-hbase4:44573] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:19,072 DEBUG [jenkins-hbase4:44573] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:19,072 DEBUG [jenkins-hbase4:44573] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:19,073 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43751,1675861398672, state=OPENING 2023-02-08 13:03:19,074 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 13:03:19,075 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:19,075 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:03:19,075 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43751,1675861398672}] 2023-02-08 13:03:19,229 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:19,230 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 13:03:19,231 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43134, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 13:03:19,235 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 13:03:19,235 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:19,236 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43751%2C1675861398672.meta, suffix=.meta, logDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/WALs/jenkins-hbase4.apache.org,43751,1675861398672, archiveDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/oldWALs, maxLogs=32 2023-02-08 13:03:19,252 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36045,DS-e3557842-6791-4ec3-9fdd-19be96dfe0eb,DISK] 2023-02-08 13:03:19,252 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38853,DS-6f26e067-d6c4-4af8-82af-f01fa4ac93c3,DISK] 2023-02-08 13:03:19,254 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/WALs/jenkins-hbase4.apache.org,43751,1675861398672/jenkins-hbase4.apache.org%2C43751%2C1675861398672.meta.1675861399237.meta 2023-02-08 13:03:19,254 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38853,DS-6f26e067-d6c4-4af8-82af-f01fa4ac93c3,DISK], DatanodeInfoWithStorage[127.0.0.1:36045,DS-e3557842-6791-4ec3-9fdd-19be96dfe0eb,DISK]] 2023-02-08 13:03:19,254 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:19,254 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 13:03:19,254 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 13:03:19,255 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 13:03:19,255 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 13:03:19,255 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:19,255 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 13:03:19,255 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 13:03:19,256 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:03:19,257 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/info 2023-02-08 13:03:19,257 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/info 2023-02-08 13:03:19,257 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:03:19,258 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:19,258 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:03:19,259 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:19,259 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:19,259 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:03:19,259 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:19,260 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:03:19,260 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/table 2023-02-08 13:03:19,260 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/table 2023-02-08 13:03:19,261 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:03:19,261 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:19,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740 2023-02-08 13:03:19,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740 2023-02-08 13:03:19,264 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:03:19,265 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:03:19,266 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62965496, jitterRate=-0.061740994453430176}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:03:19,266 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675861399255Writing region info on filesystem at 1675861399255Initializing all the Stores at 1675861399256 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861399256Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861399256Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861399256Cleaning up temporary data from old regions at 1675861399263 (+7 ms)Cleaning up detritus from prior splits at 1675861399263Running coprocessor post-open hooks at 1675861399266 (+3 ms)Region opened successfully at 1675861399266 2023-02-08 13:03:19,266 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675861399229 2023-02-08 13:03:19,271 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 13:03:19,271 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 13:03:19,271 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43751,1675861398672, state=OPEN 2023-02-08 13:03:19,273 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 13:03:19,274 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:03:19,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 13:03:19,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43751,1675861398672 in 199 msec 2023-02-08 13:03:19,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 13:03:19,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 359 msec 2023-02-08 13:03:19,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 418 msec 2023-02-08 13:03:19,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675861398723, completionTime=-1 2023-02-08 13:03:19,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 13:03:19,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 13:03:19,280 DEBUG [hconnection-0x4722cb28-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:19,282 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43148, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:19,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 13:03:19,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675861459283 2023-02-08 13:03:19,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675861519283 2023-02-08 13:03:19,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-08 13:03:19,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44573,1675861398623-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44573,1675861398623-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44573,1675861398623-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44573, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:19,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 13:03:19,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:19,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 13:03:19,290 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 13:03:19,291 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:03:19,291 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:03:19,293 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/hbase/namespace/fa787723ccc9dc79ae40b0d2b1ff3afd 2023-02-08 13:03:19,293 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/hbase/namespace/fa787723ccc9dc79ae40b0d2b1ff3afd empty. 2023-02-08 13:03:19,293 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/hbase/namespace/fa787723ccc9dc79ae40b0d2b1ff3afd 2023-02-08 13:03:19,293 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 13:03:19,315 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:19,324 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => fa787723ccc9dc79ae40b0d2b1ff3afd, NAME => 'hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp 2023-02-08 13:03:19,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:19,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing fa787723ccc9dc79ae40b0d2b1ff3afd, disabling compactions & flushes 2023-02-08 13:03:19,332 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. 2023-02-08 13:03:19,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. 2023-02-08 13:03:19,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. after waiting 0 ms 2023-02-08 13:03:19,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. 2023-02-08 13:03:19,332 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. 2023-02-08 13:03:19,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for fa787723ccc9dc79ae40b0d2b1ff3afd: Waiting for close lock at 1675861399332Disabling compacts and flushes for region at 1675861399332Disabling writes for close at 1675861399332Writing region close event to WAL at 1675861399332Closed at 1675861399332 2023-02-08 13:03:19,334 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:03:19,335 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861399335"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861399335"}]},"ts":"1675861399335"} 2023-02-08 13:03:19,338 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 13:03:19,339 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:03:19,339 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861399339"}]},"ts":"1675861399339"} 2023-02-08 13:03:19,340 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 13:03:19,349 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:19,350 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:19,350 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:19,350 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:19,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fa787723ccc9dc79ae40b0d2b1ff3afd, ASSIGN}] 2023-02-08 13:03:19,355 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fa787723ccc9dc79ae40b0d2b1ff3afd, ASSIGN 2023-02-08 13:03:19,356 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=fa787723ccc9dc79ae40b0d2b1ff3afd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43751,1675861398672; forceNewPlan=false, retain=false 2023-02-08 13:03:19,506 INFO [jenkins-hbase4:44573] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 13:03:19,507 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fa787723ccc9dc79ae40b0d2b1ff3afd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:19,507 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861399507"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861399507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861399507"}]},"ts":"1675861399507"} 2023-02-08 13:03:19,509 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure fa787723ccc9dc79ae40b0d2b1ff3afd, server=jenkins-hbase4.apache.org,43751,1675861398672}] 2023-02-08 13:03:19,665 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. 2023-02-08 13:03:19,667 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43751%2C1675861398672, suffix=, logDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/WALs/jenkins-hbase4.apache.org,43751,1675861398672, archiveDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/oldWALs, maxLogs=32 2023-02-08 13:03:19,687 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36045,DS-e3557842-6791-4ec3-9fdd-19be96dfe0eb,DISK] 2023-02-08 13:03:19,687 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38853,DS-6f26e067-d6c4-4af8-82af-f01fa4ac93c3,DISK] 2023-02-08 13:03:19,689 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/WALs/jenkins-hbase4.apache.org,43751,1675861398672/jenkins-hbase4.apache.org%2C43751%2C1675861398672.1675861399667 2023-02-08 13:03:19,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36045,DS-e3557842-6791-4ec3-9fdd-19be96dfe0eb,DISK], DatanodeInfoWithStorage[127.0.0.1:38853,DS-6f26e067-d6c4-4af8-82af-f01fa4ac93c3,DISK]] 2023-02-08 13:03:19,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fa787723ccc9dc79ae40b0d2b1ff3afd, NAME => 'hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:19,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace fa787723ccc9dc79ae40b0d2b1ff3afd 2023-02-08 13:03:19,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:19,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fa787723ccc9dc79ae40b0d2b1ff3afd 2023-02-08 13:03:19,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fa787723ccc9dc79ae40b0d2b1ff3afd 2023-02-08 13:03:19,691 INFO [StoreOpener-fa787723ccc9dc79ae40b0d2b1ff3afd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region fa787723ccc9dc79ae40b0d2b1ff3afd 2023-02-08 13:03:19,693 DEBUG [StoreOpener-fa787723ccc9dc79ae40b0d2b1ff3afd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/namespace/fa787723ccc9dc79ae40b0d2b1ff3afd/info 2023-02-08 13:03:19,693 DEBUG [StoreOpener-fa787723ccc9dc79ae40b0d2b1ff3afd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/namespace/fa787723ccc9dc79ae40b0d2b1ff3afd/info 2023-02-08 13:03:19,693 INFO [StoreOpener-fa787723ccc9dc79ae40b0d2b1ff3afd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa787723ccc9dc79ae40b0d2b1ff3afd columnFamilyName info 2023-02-08 13:03:19,694 INFO [StoreOpener-fa787723ccc9dc79ae40b0d2b1ff3afd-1] regionserver.HStore(310): Store=fa787723ccc9dc79ae40b0d2b1ff3afd/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:19,695 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/namespace/fa787723ccc9dc79ae40b0d2b1ff3afd 2023-02-08 13:03:19,695 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/namespace/fa787723ccc9dc79ae40b0d2b1ff3afd 2023-02-08 13:03:19,697 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fa787723ccc9dc79ae40b0d2b1ff3afd 2023-02-08 13:03:19,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/namespace/fa787723ccc9dc79ae40b0d2b1ff3afd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:19,700 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fa787723ccc9dc79ae40b0d2b1ff3afd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69124784, jitterRate=0.030039548873901367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:03:19,700 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fa787723ccc9dc79ae40b0d2b1ff3afd: Running coprocessor pre-open hook at 1675861399690Writing region info on filesystem at 1675861399690Initializing all the Stores at 1675861399691 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861399691Cleaning up temporary data from old regions at 1675861399695 (+4 ms)Cleaning up detritus from prior splits at 1675861399696 (+1 ms)Running coprocessor post-open hooks at 1675861399700 (+4 ms)Region opened successfully at 1675861399700 2023-02-08 13:03:19,700 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd., pid=6, masterSystemTime=1675861399662 2023-02-08 13:03:19,703 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. 2023-02-08 13:03:19,703 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. 2023-02-08 13:03:19,703 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fa787723ccc9dc79ae40b0d2b1ff3afd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:19,704 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861399703"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861399703"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861399703"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861399703"}]},"ts":"1675861399703"} 2023-02-08 13:03:19,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 13:03:19,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure fa787723ccc9dc79ae40b0d2b1ff3afd, server=jenkins-hbase4.apache.org,43751,1675861398672 in 196 msec 2023-02-08 13:03:19,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 13:03:19,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=fa787723ccc9dc79ae40b0d2b1ff3afd, ASSIGN in 356 msec 2023-02-08 13:03:19,708 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:03:19,709 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861399708"}]},"ts":"1675861399708"} 2023-02-08 13:03:19,710 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 13:03:19,712 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:03:19,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 423 msec 2023-02-08 13:03:19,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 13:03:19,792 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:19,792 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:19,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 13:03:19,803 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:19,806 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-08 13:03:19,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 13:03:19,824 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:19,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-08 13:03:19,832 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 13:03:19,834 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 13:03:19,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.107sec 2023-02-08 13:03:19,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 13:03:19,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 13:03:19,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 13:03:19,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44573,1675861398623-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 13:03:19,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44573,1675861398623-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 13:03:19,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 13:03:19,921 DEBUG [Listener at localhost/33639] zookeeper.ReadOnlyZKClient(139): Connect 0x354ff4d2 to 127.0.0.1:51700 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:19,926 DEBUG [Listener at localhost/33639] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76880901, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:19,927 DEBUG [hconnection-0x5d4369f5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:19,930 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43156, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:19,931 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44573,1675861398623 2023-02-08 13:03:19,931 DEBUG [Listener at localhost/33639] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 13:03:19,931 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:19,931 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:19,933 DEBUG [Listener at localhost/33639] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 13:03:19,935 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45212, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 13:03:19,935 INFO [Listener at localhost/33639] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-08 13:03:19,936 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-08 13:03:19,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 13:03:19,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:45212 deadline: 1675861459935, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-08 13:03:19,936 INFO [Listener at localhost/33639] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-08 13:03:19,936 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:19,937 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:19,938 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:19,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:19,941 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:03:19,941 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-08 13:03:19,941 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:19,941 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:19,941 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:03:19,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:19,950 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:19,950 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140 2023-02-08 13:03:19,950 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:19,950 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:19,950 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:19,950 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:19,950 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:19,950 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690 empty. 2023-02-08 13:03:19,950 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:19,951 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039 empty. 2023-02-08 13:03:19,951 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629 empty. 2023-02-08 13:03:19,951 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:19,951 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:19,951 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2 empty. 2023-02-08 13:03:19,951 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140 empty. 2023-02-08 13:03:19,951 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71 empty. 2023-02-08 13:03:19,951 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01 empty. 2023-02-08 13:03:19,951 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505 empty. 2023-02-08 13:03:19,952 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:19,952 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:19,952 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968 empty. 2023-02-08 13:03:19,952 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:19,952 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6 empty. 2023-02-08 13:03:19,952 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:19,952 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:19,952 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:19,953 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:19,953 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140 2023-02-08 13:03:19,953 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:19,953 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:19,953 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-08 13:03:19,965 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:19,967 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => a483102b691671503ad7e7727d21c140, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp 2023-02-08 13:03:19,967 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => b4e8cbd16c49c254c64e02f036e9aa71, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp 2023-02-08 13:03:19,967 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6e34a05f1123d6630f6f06db6da6b690, NAME => 'testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp 2023-02-08 13:03:19,980 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:19,980 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:19,980 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 6e34a05f1123d6630f6f06db6da6b690, disabling compactions & flushes 2023-02-08 13:03:19,981 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:19,981 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:19,981 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. after waiting 0 ms 2023-02-08 13:03:19,981 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:19,981 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:19,980 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing a483102b691671503ad7e7727d21c140, disabling compactions & flushes 2023-02-08 13:03:19,981 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 6e34a05f1123d6630f6f06db6da6b690: Waiting for close lock at 1675861399980Disabling compacts and flushes for region at 1675861399980Disabling writes for close at 1675861399981 (+1 ms)Writing region close event to WAL at 1675861399981Closed at 1675861399981 2023-02-08 13:03:19,981 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:19,982 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:19,982 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 14b62f8b8e0b4b3a0a607fbbaafc0d01, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp 2023-02-08 13:03:19,982 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. after waiting 0 ms 2023-02-08 13:03:19,982 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:19,982 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:19,982 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for a483102b691671503ad7e7727d21c140: Waiting for close lock at 1675861399980Disabling compacts and flushes for region at 1675861399980Disabling writes for close at 1675861399982 (+2 ms)Writing region close event to WAL at 1675861399982Closed at 1675861399982 2023-02-08 13:03:19,983 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => af105189d7e976ff1119f2d054c2d629, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp 2023-02-08 13:03:19,983 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:19,983 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing b4e8cbd16c49c254c64e02f036e9aa71, disabling compactions & flushes 2023-02-08 13:03:19,983 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:19,983 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:19,983 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. after waiting 0 ms 2023-02-08 13:03:19,983 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:19,983 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:19,983 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for b4e8cbd16c49c254c64e02f036e9aa71: Waiting for close lock at 1675861399983Disabling compacts and flushes for region at 1675861399983Disabling writes for close at 1675861399983Writing region close event to WAL at 1675861399983Closed at 1675861399983 2023-02-08 13:03:19,983 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => f34bf6256167e7e68f1aee5b33d38039, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp 2023-02-08 13:03:20,000 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,000 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 14b62f8b8e0b4b3a0a607fbbaafc0d01, disabling compactions & flushes 2023-02-08 13:03:20,000 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:20,000 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:20,000 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. after waiting 0 ms 2023-02-08 13:03:20,000 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:20,001 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:20,001 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 14b62f8b8e0b4b3a0a607fbbaafc0d01: Waiting for close lock at 1675861400000Disabling compacts and flushes for region at 1675861400000Disabling writes for close at 1675861400000Writing region close event to WAL at 1675861400001 (+1 ms)Closed at 1675861400001 2023-02-08 13:03:20,001 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5fa62d397beda9fc152ed91752b959e2, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp 2023-02-08 13:03:20,008 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,008 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing af105189d7e976ff1119f2d054c2d629, disabling compactions & flushes 2023-02-08 13:03:20,008 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:20,008 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:20,008 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. after waiting 0 ms 2023-02-08 13:03:20,008 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:20,008 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:20,008 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for af105189d7e976ff1119f2d054c2d629: Waiting for close lock at 1675861400008Disabling compacts and flushes for region at 1675861400008Disabling writes for close at 1675861400008Writing region close event to WAL at 1675861400008Closed at 1675861400008 2023-02-08 13:03:20,009 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => efce11bf79d10a7a0e0ca8c92802c505, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp 2023-02-08 13:03:20,013 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,014 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 5fa62d397beda9fc152ed91752b959e2, disabling compactions & flushes 2023-02-08 13:03:20,014 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:20,014 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:20,014 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. after waiting 0 ms 2023-02-08 13:03:20,014 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:20,014 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:20,014 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 5fa62d397beda9fc152ed91752b959e2: Waiting for close lock at 1675861400014Disabling compacts and flushes for region at 1675861400014Disabling writes for close at 1675861400014Writing region close event to WAL at 1675861400014Closed at 1675861400014 2023-02-08 13:03:20,014 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => b0affe31618e6bfe674fdedfa4e15968, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp 2023-02-08 13:03:20,016 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,016 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing efce11bf79d10a7a0e0ca8c92802c505, disabling compactions & flushes 2023-02-08 13:03:20,016 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:20,016 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:20,016 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. after waiting 0 ms 2023-02-08 13:03:20,016 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:20,016 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:20,016 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for efce11bf79d10a7a0e0ca8c92802c505: Waiting for close lock at 1675861400016Disabling compacts and flushes for region at 1675861400016Disabling writes for close at 1675861400016Writing region close event to WAL at 1675861400016Closed at 1675861400016 2023-02-08 13:03:20,017 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1dedfa6ce0377768d24a0625a5bf81f6, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp 2023-02-08 13:03:20,021 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,021 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing b0affe31618e6bfe674fdedfa4e15968, disabling compactions & flushes 2023-02-08 13:03:20,021 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:20,021 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:20,021 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. after waiting 0 ms 2023-02-08 13:03:20,021 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:20,021 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:20,021 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for b0affe31618e6bfe674fdedfa4e15968: Waiting for close lock at 1675861400021Disabling compacts and flushes for region at 1675861400021Disabling writes for close at 1675861400021Writing region close event to WAL at 1675861400021Closed at 1675861400021 2023-02-08 13:03:20,027 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,027 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 1dedfa6ce0377768d24a0625a5bf81f6, disabling compactions & flushes 2023-02-08 13:03:20,027 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:20,027 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:20,027 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. after waiting 0 ms 2023-02-08 13:03:20,027 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:20,027 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:20,027 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 1dedfa6ce0377768d24a0625a5bf81f6: Waiting for close lock at 1675861400027Disabling compacts and flushes for region at 1675861400027Disabling writes for close at 1675861400027Writing region close event to WAL at 1675861400027Closed at 1675861400027 2023-02-08 13:03:20,042 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:20,043 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:20,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:20,045 INFO [RS:1;jenkins-hbase4:40069] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40069%2C1675861398701, suffix=, logDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/WALs/jenkins-hbase4.apache.org,40069,1675861398701, archiveDir=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/oldWALs, maxLogs=32 2023-02-08 13:03:20,060 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36045,DS-e3557842-6791-4ec3-9fdd-19be96dfe0eb,DISK] 2023-02-08 13:03:20,061 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38853,DS-6f26e067-d6c4-4af8-82af-f01fa4ac93c3,DISK] 2023-02-08 13:03:20,063 INFO [RS:1;jenkins-hbase4:40069] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/WALs/jenkins-hbase4.apache.org,40069,1675861398701/jenkins-hbase4.apache.org%2C40069%2C1675861398701.1675861400045 2023-02-08 13:03:20,064 DEBUG [RS:1;jenkins-hbase4:40069] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36045,DS-e3557842-6791-4ec3-9fdd-19be96dfe0eb,DISK], DatanodeInfoWithStorage[127.0.0.1:38853,DS-6f26e067-d6c4-4af8-82af-f01fa4ac93c3,DISK]] 2023-02-08 13:03:20,244 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:20,244 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:20,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:20,411 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,411 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing f34bf6256167e7e68f1aee5b33d38039, disabling compactions & flushes 2023-02-08 13:03:20,411 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:20,411 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:20,411 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. after waiting 0 ms 2023-02-08 13:03:20,411 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:20,411 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:20,411 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for f34bf6256167e7e68f1aee5b33d38039: Waiting for close lock at 1675861400411Disabling compacts and flushes for region at 1675861400411Disabling writes for close at 1675861400411Writing region close event to WAL at 1675861400411Closed at 1675861400411 2023-02-08 13:03:20,414 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:03:20,415 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675861400415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861400415"}]},"ts":"1675861400415"} 2023-02-08 13:03:20,415 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675861399938.a483102b691671503ad7e7727d21c140.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861400415"}]},"ts":"1675861400415"} 2023-02-08 13:03:20,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861400415"}]},"ts":"1675861400415"} 2023-02-08 13:03:20,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861400415"}]},"ts":"1675861400415"} 2023-02-08 13:03:20,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861400415"}]},"ts":"1675861400415"} 2023-02-08 13:03:20,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861400415"}]},"ts":"1675861400415"} 2023-02-08 13:03:20,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861400415"}]},"ts":"1675861400415"} 2023-02-08 13:03:20,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861400415"}]},"ts":"1675861400415"} 2023-02-08 13:03:20,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675861400415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861400415"}]},"ts":"1675861400415"} 2023-02-08 13:03:20,416 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861400415"}]},"ts":"1675861400415"} 2023-02-08 13:03:20,440 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-08 13:03:20,441 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:03:20,442 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861400442"}]},"ts":"1675861400442"} 2023-02-08 13:03:20,443 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-08 13:03:20,447 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:20,455 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:20,455 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:20,455 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:20,456 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e34a05f1123d6630f6f06db6da6b690, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4e8cbd16c49c254c64e02f036e9aa71, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a483102b691671503ad7e7727d21c140, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14b62f8b8e0b4b3a0a607fbbaafc0d01, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=af105189d7e976ff1119f2d054c2d629, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f34bf6256167e7e68f1aee5b33d38039, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fa62d397beda9fc152ed91752b959e2, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=efce11bf79d10a7a0e0ca8c92802c505, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0affe31618e6bfe674fdedfa4e15968, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1dedfa6ce0377768d24a0625a5bf81f6, ASSIGN}] 2023-02-08 13:03:20,460 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14b62f8b8e0b4b3a0a607fbbaafc0d01, ASSIGN 2023-02-08 13:03:20,460 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a483102b691671503ad7e7727d21c140, ASSIGN 2023-02-08 13:03:20,461 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4e8cbd16c49c254c64e02f036e9aa71, ASSIGN 2023-02-08 13:03:20,461 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e34a05f1123d6630f6f06db6da6b690, ASSIGN 2023-02-08 13:03:20,462 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1dedfa6ce0377768d24a0625a5bf81f6, ASSIGN 2023-02-08 13:03:20,462 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14b62f8b8e0b4b3a0a607fbbaafc0d01, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40069,1675861398701; forceNewPlan=false, retain=false 2023-02-08 13:03:20,462 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a483102b691671503ad7e7727d21c140, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40069,1675861398701; forceNewPlan=false, retain=false 2023-02-08 13:03:20,462 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4e8cbd16c49c254c64e02f036e9aa71, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43751,1675861398672; forceNewPlan=false, retain=false 2023-02-08 13:03:20,462 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e34a05f1123d6630f6f06db6da6b690, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43751,1675861398672; forceNewPlan=false, retain=false 2023-02-08 13:03:20,463 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1dedfa6ce0377768d24a0625a5bf81f6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43751,1675861398672; forceNewPlan=false, retain=false 2023-02-08 13:03:20,464 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0affe31618e6bfe674fdedfa4e15968, ASSIGN 2023-02-08 13:03:20,464 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=efce11bf79d10a7a0e0ca8c92802c505, ASSIGN 2023-02-08 13:03:20,464 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fa62d397beda9fc152ed91752b959e2, ASSIGN 2023-02-08 13:03:20,464 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f34bf6256167e7e68f1aee5b33d38039, ASSIGN 2023-02-08 13:03:20,464 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=af105189d7e976ff1119f2d054c2d629, ASSIGN 2023-02-08 13:03:20,465 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0affe31618e6bfe674fdedfa4e15968, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40069,1675861398701; forceNewPlan=false, retain=false 2023-02-08 13:03:20,465 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fa62d397beda9fc152ed91752b959e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40069,1675861398701; forceNewPlan=false, retain=false 2023-02-08 13:03:20,465 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=efce11bf79d10a7a0e0ca8c92802c505, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43751,1675861398672; forceNewPlan=false, retain=false 2023-02-08 13:03:20,465 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f34bf6256167e7e68f1aee5b33d38039, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40069,1675861398701; forceNewPlan=false, retain=false 2023-02-08 13:03:20,465 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=af105189d7e976ff1119f2d054c2d629, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43751,1675861398672; forceNewPlan=false, retain=false 2023-02-08 13:03:20,546 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:20,546 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:20,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:20,612 INFO [jenkins-hbase4:44573] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-08 13:03:20,618 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=af105189d7e976ff1119f2d054c2d629, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:20,618 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1dedfa6ce0377768d24a0625a5bf81f6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:20,618 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=b4e8cbd16c49c254c64e02f036e9aa71, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:20,618 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=efce11bf79d10a7a0e0ca8c92802c505, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:20,618 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=6e34a05f1123d6630f6f06db6da6b690, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:20,618 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861400618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861400618"}]},"ts":"1675861400618"} 2023-02-08 13:03:20,618 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861400618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861400618"}]},"ts":"1675861400618"} 2023-02-08 13:03:20,618 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675861400618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861400618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861400618"}]},"ts":"1675861400618"} 2023-02-08 13:03:20,618 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861400618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861400618"}]},"ts":"1675861400618"} 2023-02-08 13:03:20,618 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675861400618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861400618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861400618"}]},"ts":"1675861400618"} 2023-02-08 13:03:20,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure efce11bf79d10a7a0e0ca8c92802c505, server=jenkins-hbase4.apache.org,43751,1675861398672}] 2023-02-08 13:03:20,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure b4e8cbd16c49c254c64e02f036e9aa71, server=jenkins-hbase4.apache.org,43751,1675861398672}] 2023-02-08 13:03:20,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure 1dedfa6ce0377768d24a0625a5bf81f6, server=jenkins-hbase4.apache.org,43751,1675861398672}] 2023-02-08 13:03:20,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=15, state=RUNNABLE; OpenRegionProcedure af105189d7e976ff1119f2d054c2d629, server=jenkins-hbase4.apache.org,43751,1675861398672}] 2023-02-08 13:03:20,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=11, state=RUNNABLE; OpenRegionProcedure 6e34a05f1123d6630f6f06db6da6b690, server=jenkins-hbase4.apache.org,43751,1675861398672}] 2023-02-08 13:03:20,623 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a483102b691671503ad7e7727d21c140, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:20,623 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f34bf6256167e7e68f1aee5b33d38039, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:20,624 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675861399938.a483102b691671503ad7e7727d21c140.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400623"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861400623"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861400623"}]},"ts":"1675861400623"} 2023-02-08 13:03:20,624 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400623"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861400623"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861400623"}]},"ts":"1675861400623"} 2023-02-08 13:03:20,624 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=5fa62d397beda9fc152ed91752b959e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:20,625 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400624"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861400624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861400624"}]},"ts":"1675861400624"} 2023-02-08 13:03:20,625 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b0affe31618e6bfe674fdedfa4e15968, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:20,625 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400625"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861400625"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861400625"}]},"ts":"1675861400625"} 2023-02-08 13:03:20,626 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=14b62f8b8e0b4b3a0a607fbbaafc0d01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:20,626 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400626"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861400626"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861400626"}]},"ts":"1675861400626"} 2023-02-08 13:03:20,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure a483102b691671503ad7e7727d21c140, server=jenkins-hbase4.apache.org,40069,1675861398701}] 2023-02-08 13:03:20,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=16, state=RUNNABLE; OpenRegionProcedure f34bf6256167e7e68f1aee5b33d38039, server=jenkins-hbase4.apache.org,40069,1675861398701}] 2023-02-08 13:03:20,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure 5fa62d397beda9fc152ed91752b959e2, server=jenkins-hbase4.apache.org,40069,1675861398701}] 2023-02-08 13:03:20,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=19, state=RUNNABLE; OpenRegionProcedure b0affe31618e6bfe674fdedfa4e15968, server=jenkins-hbase4.apache.org,40069,1675861398701}] 2023-02-08 13:03:20,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure 14b62f8b8e0b4b3a0a607fbbaafc0d01, server=jenkins-hbase4.apache.org,40069,1675861398701}] 2023-02-08 13:03:20,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:20,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => efce11bf79d10a7a0e0ca8c92802c505, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-08 13:03:20,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:20,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:20,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:20,777 INFO [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:20,777 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:20,778 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 13:03:20,779 DEBUG [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1 2023-02-08 13:03:20,779 DEBUG [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1 2023-02-08 13:03:20,779 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36334, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 13:03:20,779 INFO [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efce11bf79d10a7a0e0ca8c92802c505 columnFamilyName f1 2023-02-08 13:03:20,780 INFO [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] regionserver.HStore(310): Store=efce11bf79d10a7a0e0ca8c92802c505/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,780 INFO [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:20,782 DEBUG [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2 2023-02-08 13:03:20,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:20,782 DEBUG [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2 2023-02-08 13:03:20,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5fa62d397beda9fc152ed91752b959e2, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-08 13:03:20,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:20,782 INFO [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efce11bf79d10a7a0e0ca8c92802c505 columnFamilyName f2 2023-02-08 13:03:20,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:20,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:20,783 INFO [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] regionserver.HStore(310): Store=efce11bf79d10a7a0e0ca8c92802c505/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:20,783 INFO [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:20,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:20,784 DEBUG [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1 2023-02-08 13:03:20,785 DEBUG [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1 2023-02-08 13:03:20,785 INFO [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fa62d397beda9fc152ed91752b959e2 columnFamilyName f1 2023-02-08 13:03:20,785 INFO [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] regionserver.HStore(310): Store=5fa62d397beda9fc152ed91752b959e2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,785 INFO [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:20,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:20,786 DEBUG [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2 2023-02-08 13:03:20,786 DEBUG [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2 2023-02-08 13:03:20,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:20,787 INFO [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fa62d397beda9fc152ed91752b959e2 columnFamilyName f2 2023-02-08 13:03:20,787 INFO [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] regionserver.HStore(310): Store=5fa62d397beda9fc152ed91752b959e2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:20,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:20,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:20,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened efce11bf79d10a7a0e0ca8c92802c505; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75294819, jitterRate=0.12198023498058319}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:20,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for efce11bf79d10a7a0e0ca8c92802c505: Running coprocessor pre-open hook at 1675861400776Writing region info on filesystem at 1675861400776Initializing all the Stores at 1675861400777 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400777Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400777Cleaning up temporary data from old regions at 1675861400784 (+7 ms)Cleaning up detritus from prior splits at 1675861400785 (+1 ms)Running coprocessor post-open hooks at 1675861400789 (+4 ms)Region opened successfully at 1675861400789 2023-02-08 13:03:20,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505., pid=21, masterSystemTime=1675861400772 2023-02-08 13:03:20,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:20,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:20,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:20,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:20,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:20,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1dedfa6ce0377768d24a0625a5bf81f6, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-08 13:03:20,791 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=efce11bf79d10a7a0e0ca8c92802c505, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:20,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:20,791 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400791"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861400791"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861400791"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861400791"}]},"ts":"1675861400791"} 2023-02-08 13:03:20,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:20,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:20,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:20,793 INFO [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:20,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5fa62d397beda9fc152ed91752b959e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72613075, jitterRate=0.0820191353559494}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:20,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5fa62d397beda9fc152ed91752b959e2: Running coprocessor pre-open hook at 1675861400782Writing region info on filesystem at 1675861400782Initializing all the Stores at 1675861400783 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400783Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400783Cleaning up temporary data from old regions at 1675861400789 (+6 ms)Cleaning up detritus from prior splits at 1675861400789Running coprocessor post-open hooks at 1675861400794 (+5 ms)Region opened successfully at 1675861400794 2023-02-08 13:03:20,794 DEBUG [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6/f1 2023-02-08 13:03:20,794 DEBUG [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6/f1 2023-02-08 13:03:20,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2., pid=28, masterSystemTime=1675861400777 2023-02-08 13:03:20,795 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-08 13:03:20,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure efce11bf79d10a7a0e0ca8c92802c505, server=jenkins-hbase4.apache.org,43751,1675861398672 in 173 msec 2023-02-08 13:03:20,796 INFO [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1dedfa6ce0377768d24a0625a5bf81f6 columnFamilyName f1 2023-02-08 13:03:20,797 INFO [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] regionserver.HStore(310): Store=1dedfa6ce0377768d24a0625a5bf81f6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,797 INFO [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:20,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:20,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:20,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:20,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=efce11bf79d10a7a0e0ca8c92802c505, ASSIGN in 340 msec 2023-02-08 13:03:20,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b0affe31618e6bfe674fdedfa4e15968, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-08 13:03:20,798 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=5fa62d397beda9fc152ed91752b959e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:20,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:20,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:20,798 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400798"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861400798"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861400798"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861400798"}]},"ts":"1675861400798"} 2023-02-08 13:03:20,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:20,799 INFO [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:20,800 DEBUG [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1 2023-02-08 13:03:20,800 DEBUG [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1 2023-02-08 13:03:20,801 INFO [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0affe31618e6bfe674fdedfa4e15968 columnFamilyName f1 2023-02-08 13:03:20,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-08 13:03:20,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure 5fa62d397beda9fc152ed91752b959e2, server=jenkins-hbase4.apache.org,40069,1675861398701 in 172 msec 2023-02-08 13:03:20,801 INFO [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] regionserver.HStore(310): Store=b0affe31618e6bfe674fdedfa4e15968/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,801 INFO [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:20,802 DEBUG [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2 2023-02-08 13:03:20,802 DEBUG [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2 2023-02-08 13:03:20,803 INFO [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0affe31618e6bfe674fdedfa4e15968 columnFamilyName f2 2023-02-08 13:03:20,803 INFO [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] regionserver.HStore(310): Store=b0affe31618e6bfe674fdedfa4e15968/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fa62d397beda9fc152ed91752b959e2, ASSIGN in 345 msec 2023-02-08 13:03:20,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:20,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:20,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:20,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:20,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:20,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b0affe31618e6bfe674fdedfa4e15968; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63313667, jitterRate=-0.05655284225940704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:20,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b0affe31618e6bfe674fdedfa4e15968: Running coprocessor pre-open hook at 1675861400798Writing region info on filesystem at 1675861400798Initializing all the Stores at 1675861400799 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400799Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400799Cleaning up temporary data from old regions at 1675861400804 (+5 ms)Cleaning up detritus from prior splits at 1675861400805 (+1 ms)Running coprocessor post-open hooks at 1675861400808 (+3 ms)Region opened successfully at 1675861400808 2023-02-08 13:03:20,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968., pid=29, masterSystemTime=1675861400777 2023-02-08 13:03:20,809 DEBUG [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6/f2 2023-02-08 13:03:20,809 DEBUG [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6/f2 2023-02-08 13:03:20,809 INFO [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1dedfa6ce0377768d24a0625a5bf81f6 columnFamilyName f2 2023-02-08 13:03:20,809 INFO [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] regionserver.HStore(310): Store=1dedfa6ce0377768d24a0625a5bf81f6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:20,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:20,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:20,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:20,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 14b62f8b8e0b4b3a0a607fbbaafc0d01, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-08 13:03:20,810 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b0affe31618e6bfe674fdedfa4e15968, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:20,810 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400810"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861400810"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861400810"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861400810"}]},"ts":"1675861400810"} 2023-02-08 13:03:20,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:20,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:20,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:20,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:20,812 INFO [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:20,813 DEBUG [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1 2023-02-08 13:03:20,813 DEBUG [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1 2023-02-08 13:03:20,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:20,813 INFO [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14b62f8b8e0b4b3a0a607fbbaafc0d01 columnFamilyName f1 2023-02-08 13:03:20,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=19 2023-02-08 13:03:20,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=19, state=SUCCESS; OpenRegionProcedure b0affe31618e6bfe674fdedfa4e15968, server=jenkins-hbase4.apache.org,40069,1675861398701 in 184 msec 2023-02-08 13:03:20,814 INFO [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] regionserver.HStore(310): Store=14b62f8b8e0b4b3a0a607fbbaafc0d01/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,814 INFO [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:20,814 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0affe31618e6bfe674fdedfa4e15968, ASSIGN in 357 msec 2023-02-08 13:03:20,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:20,815 DEBUG [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2 2023-02-08 13:03:20,815 DEBUG [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2 2023-02-08 13:03:20,815 INFO [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14b62f8b8e0b4b3a0a607fbbaafc0d01 columnFamilyName f2 2023-02-08 13:03:20,815 INFO [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] regionserver.HStore(310): Store=14b62f8b8e0b4b3a0a607fbbaafc0d01/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:20,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:20,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:20,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1dedfa6ce0377768d24a0625a5bf81f6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74588848, jitterRate=0.11146044731140137}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:20,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1dedfa6ce0377768d24a0625a5bf81f6: Running coprocessor pre-open hook at 1675861400792Writing region info on filesystem at 1675861400792Initializing all the Stores at 1675861400792Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400792Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400793 (+1 ms)Cleaning up temporary data from old regions at 1675861400812 (+19 ms)Cleaning up detritus from prior splits at 1675861400812Running coprocessor post-open hooks at 1675861400817 (+5 ms)Region opened successfully at 1675861400817 2023-02-08 13:03:20,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6., pid=23, masterSystemTime=1675861400772 2023-02-08 13:03:20,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:20,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:20,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:20,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:20,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => af105189d7e976ff1119f2d054c2d629, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-08 13:03:20,819 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1dedfa6ce0377768d24a0625a5bf81f6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:20,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:20,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,819 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675861400819"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861400819"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861400819"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861400819"}]},"ts":"1675861400819"} 2023-02-08 13:03:20,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:20,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:20,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:20,820 INFO [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:20,822 DEBUG [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1 2023-02-08 13:03:20,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:20,822 DEBUG [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1 2023-02-08 13:03:20,822 INFO [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af105189d7e976ff1119f2d054c2d629 columnFamilyName f1 2023-02-08 13:03:20,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 14b62f8b8e0b4b3a0a607fbbaafc0d01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68156451, jitterRate=0.015610262751579285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:20,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 14b62f8b8e0b4b3a0a607fbbaafc0d01: Running coprocessor pre-open hook at 1675861400811Writing region info on filesystem at 1675861400811Initializing all the Stores at 1675861400811Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400811Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400811Cleaning up temporary data from old regions at 1675861400817 (+6 ms)Cleaning up detritus from prior splits at 1675861400817Running coprocessor post-open hooks at 1675861400823 (+6 ms)Region opened successfully at 1675861400823 2023-02-08 13:03:20,823 INFO [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] regionserver.HStore(310): Store=af105189d7e976ff1119f2d054c2d629/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,823 INFO [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:20,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01., pid=30, masterSystemTime=1675861400777 2023-02-08 13:03:20,824 DEBUG [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2 2023-02-08 13:03:20,824 DEBUG [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2 2023-02-08 13:03:20,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:20,824 INFO [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af105189d7e976ff1119f2d054c2d629 columnFamilyName f2 2023-02-08 13:03:20,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:20,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:20,825 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=14b62f8b8e0b4b3a0a607fbbaafc0d01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:20,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f34bf6256167e7e68f1aee5b33d38039, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-08 13:03:20,825 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400825"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861400825"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861400825"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861400825"}]},"ts":"1675861400825"} 2023-02-08 13:03:20,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-08 13:03:20,825 INFO [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] regionserver.HStore(310): Store=af105189d7e976ff1119f2d054c2d629/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:20,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure 1dedfa6ce0377768d24a0625a5bf81f6, server=jenkins-hbase4.apache.org,43751,1675861398672 in 202 msec 2023-02-08 13:03:20,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:20,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:20,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:20,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1dedfa6ce0377768d24a0625a5bf81f6, ASSIGN in 369 msec 2023-02-08 13:03:20,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:20,827 INFO [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:20,828 DEBUG [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1 2023-02-08 13:03:20,828 DEBUG [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1 2023-02-08 13:03:20,828 INFO [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f34bf6256167e7e68f1aee5b33d38039 columnFamilyName f1 2023-02-08 13:03:20,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:20,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-08 13:03:20,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure 14b62f8b8e0b4b3a0a607fbbaafc0d01, server=jenkins-hbase4.apache.org,40069,1675861398701 in 197 msec 2023-02-08 13:03:20,829 INFO [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] regionserver.HStore(310): Store=f34bf6256167e7e68f1aee5b33d38039/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,829 INFO [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:20,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14b62f8b8e0b4b3a0a607fbbaafc0d01, ASSIGN in 372 msec 2023-02-08 13:03:20,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:20,830 DEBUG [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2 2023-02-08 13:03:20,830 DEBUG [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2 2023-02-08 13:03:20,830 INFO [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f34bf6256167e7e68f1aee5b33d38039 columnFamilyName f2 2023-02-08 13:03:20,831 INFO [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] regionserver.HStore(310): Store=f34bf6256167e7e68f1aee5b33d38039/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:20,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:20,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened af105189d7e976ff1119f2d054c2d629; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69069658, jitterRate=0.02921810746192932}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:20,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:20,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for af105189d7e976ff1119f2d054c2d629: Running coprocessor pre-open hook at 1675861400819Writing region info on filesystem at 1675861400819Initializing all the Stores at 1675861400820 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400820Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400820Cleaning up temporary data from old regions at 1675861400827 (+7 ms)Cleaning up detritus from prior splits at 1675861400827Running coprocessor post-open hooks at 1675861400832 (+5 ms)Region opened successfully at 1675861400832 2023-02-08 13:03:20,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629., pid=24, masterSystemTime=1675861400772 2023-02-08 13:03:20,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:20,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:20,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:20,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:20,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b4e8cbd16c49c254c64e02f036e9aa71, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-08 13:03:20,834 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=af105189d7e976ff1119f2d054c2d629, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:20,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:20,834 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861400834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861400834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861400834"}]},"ts":"1675861400834"} 2023-02-08 13:03:20,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:20,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:20,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:20,835 INFO [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:20,837 DEBUG [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1 2023-02-08 13:03:20,837 DEBUG [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1 2023-02-08 13:03:20,837 INFO [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4e8cbd16c49c254c64e02f036e9aa71 columnFamilyName f1 2023-02-08 13:03:20,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:20,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=15 2023-02-08 13:03:20,838 INFO [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] regionserver.HStore(310): Store=b4e8cbd16c49c254c64e02f036e9aa71/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=15, state=SUCCESS; OpenRegionProcedure af105189d7e976ff1119f2d054c2d629, server=jenkins-hbase4.apache.org,43751,1675861398672 in 213 msec 2023-02-08 13:03:20,838 INFO [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:20,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f34bf6256167e7e68f1aee5b33d38039; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71295259, jitterRate=0.06238214671611786}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:20,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f34bf6256167e7e68f1aee5b33d38039: Running coprocessor pre-open hook at 1675861400825Writing region info on filesystem at 1675861400825Initializing all the Stores at 1675861400826 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400826Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400826Cleaning up temporary data from old regions at 1675861400832 (+6 ms)Cleaning up detritus from prior splits at 1675861400833 (+1 ms)Running coprocessor post-open hooks at 1675861400838 (+5 ms)Region opened successfully at 1675861400838 2023-02-08 13:03:20,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039., pid=27, masterSystemTime=1675861400777 2023-02-08 13:03:20,840 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=af105189d7e976ff1119f2d054c2d629, ASSIGN in 382 msec 2023-02-08 13:03:20,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:20,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:20,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:20,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a483102b691671503ad7e7727d21c140, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-08 13:03:20,841 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f34bf6256167e7e68f1aee5b33d38039, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:20,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion a483102b691671503ad7e7727d21c140 2023-02-08 13:03:20,841 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400841"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861400841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861400841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861400841"}]},"ts":"1675861400841"} 2023-02-08 13:03:20,841 DEBUG [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2 2023-02-08 13:03:20,841 DEBUG [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2 2023-02-08 13:03:20,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a483102b691671503ad7e7727d21c140 2023-02-08 13:03:20,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a483102b691671503ad7e7727d21c140 2023-02-08 13:03:20,841 INFO [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4e8cbd16c49c254c64e02f036e9aa71 columnFamilyName f2 2023-02-08 13:03:20,842 INFO [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] regionserver.HStore(310): Store=b4e8cbd16c49c254c64e02f036e9aa71/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:20,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:20,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=16 2023-02-08 13:03:20,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=16, state=SUCCESS; OpenRegionProcedure f34bf6256167e7e68f1aee5b33d38039, server=jenkins-hbase4.apache.org,40069,1675861398701 in 215 msec 2023-02-08 13:03:20,844 INFO [StoreOpener-a483102b691671503ad7e7727d21c140-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a483102b691671503ad7e7727d21c140 2023-02-08 13:03:20,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f34bf6256167e7e68f1aee5b33d38039, ASSIGN in 388 msec 2023-02-08 13:03:20,845 DEBUG [StoreOpener-a483102b691671503ad7e7727d21c140-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1 2023-02-08 13:03:20,845 DEBUG [StoreOpener-a483102b691671503ad7e7727d21c140-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1 2023-02-08 13:03:20,846 INFO [StoreOpener-a483102b691671503ad7e7727d21c140-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a483102b691671503ad7e7727d21c140 columnFamilyName f1 2023-02-08 13:03:20,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:20,846 INFO [StoreOpener-a483102b691671503ad7e7727d21c140-1] regionserver.HStore(310): Store=a483102b691671503ad7e7727d21c140/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,846 INFO [StoreOpener-a483102b691671503ad7e7727d21c140-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a483102b691671503ad7e7727d21c140 2023-02-08 13:03:20,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:20,847 DEBUG [StoreOpener-a483102b691671503ad7e7727d21c140-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2 2023-02-08 13:03:20,847 DEBUG [StoreOpener-a483102b691671503ad7e7727d21c140-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2 2023-02-08 13:03:20,848 INFO [StoreOpener-a483102b691671503ad7e7727d21c140-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a483102b691671503ad7e7727d21c140 columnFamilyName f2 2023-02-08 13:03:20,848 INFO [StoreOpener-a483102b691671503ad7e7727d21c140-1] regionserver.HStore(310): Store=a483102b691671503ad7e7727d21c140/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:20,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140 2023-02-08 13:03:20,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b4e8cbd16c49c254c64e02f036e9aa71; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61121229, jitterRate=-0.08922271430492401}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:20,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b4e8cbd16c49c254c64e02f036e9aa71: Running coprocessor pre-open hook at 1675861400834Writing region info on filesystem at 1675861400834Initializing all the Stores at 1675861400835 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400835Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400835Cleaning up temporary data from old regions at 1675861400844 (+9 ms)Cleaning up detritus from prior splits at 1675861400845 (+1 ms)Running coprocessor post-open hooks at 1675861400849 (+4 ms)Region opened successfully at 1675861400849 2023-02-08 13:03:20,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140 2023-02-08 13:03:20,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71., pid=22, masterSystemTime=1675861400772 2023-02-08 13:03:20,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:20,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:20,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:20,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:20,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6e34a05f1123d6630f6f06db6da6b690, NAME => 'testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-08 13:03:20,852 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=b4e8cbd16c49c254c64e02f036e9aa71, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:20,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:20,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:20,852 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400852"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861400852"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861400852"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861400852"}]},"ts":"1675861400852"} 2023-02-08 13:03:20,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:20,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:20,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a483102b691671503ad7e7727d21c140 2023-02-08 13:03:20,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:20,855 INFO [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:20,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-08 13:03:20,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure b4e8cbd16c49c254c64e02f036e9aa71, server=jenkins-hbase4.apache.org,43751,1675861398672 in 232 msec 2023-02-08 13:03:20,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a483102b691671503ad7e7727d21c140; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73035704, jitterRate=0.08831679821014404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:20,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a483102b691671503ad7e7727d21c140: Running coprocessor pre-open hook at 1675861400841Writing region info on filesystem at 1675861400841Initializing all the Stores at 1675861400842 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400842Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400844 (+2 ms)Cleaning up temporary data from old regions at 1675861400850 (+6 ms)Cleaning up detritus from prior splits at 1675861400851 (+1 ms)Running coprocessor post-open hooks at 1675861400855 (+4 ms)Region opened successfully at 1675861400855 2023-02-08 13:03:20,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140., pid=26, masterSystemTime=1675861400777 2023-02-08 13:03:20,856 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4e8cbd16c49c254c64e02f036e9aa71, ASSIGN in 399 msec 2023-02-08 13:03:20,856 DEBUG [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690/f1 2023-02-08 13:03:20,856 DEBUG [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690/f1 2023-02-08 13:03:20,857 INFO [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e34a05f1123d6630f6f06db6da6b690 columnFamilyName f1 2023-02-08 13:03:20,857 INFO [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] regionserver.HStore(310): Store=6e34a05f1123d6630f6f06db6da6b690/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,857 INFO [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:20,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:20,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:20,857 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a483102b691671503ad7e7727d21c140, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:20,858 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675861399938.a483102b691671503ad7e7727d21c140.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861400857"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861400857"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861400857"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861400857"}]},"ts":"1675861400857"} 2023-02-08 13:03:20,858 DEBUG [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690/f2 2023-02-08 13:03:20,859 DEBUG [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690/f2 2023-02-08 13:03:20,859 INFO [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e34a05f1123d6630f6f06db6da6b690 columnFamilyName f2 2023-02-08 13:03:20,859 INFO [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] regionserver.HStore(310): Store=6e34a05f1123d6630f6f06db6da6b690/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:20,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:20,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-08 13:03:20,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure a483102b691671503ad7e7727d21c140, server=jenkins-hbase4.apache.org,40069,1675861398701 in 233 msec 2023-02-08 13:03:20,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:20,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a483102b691671503ad7e7727d21c140, ASSIGN in 404 msec 2023-02-08 13:03:20,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:20,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:20,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:20,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6e34a05f1123d6630f6f06db6da6b690; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62723787, jitterRate=-0.0653427392244339}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:20,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6e34a05f1123d6630f6f06db6da6b690: Running coprocessor pre-open hook at 1675861400852Writing region info on filesystem at 1675861400852Initializing all the Stores at 1675861400853 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400853Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861400853Cleaning up temporary data from old regions at 1675861400861 (+8 ms)Cleaning up detritus from prior splits at 1675861400861Running coprocessor post-open hooks at 1675861400865 (+4 ms)Region opened successfully at 1675861400865 2023-02-08 13:03:20,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690., pid=25, masterSystemTime=1675861400772 2023-02-08 13:03:20,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:20,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:20,867 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=6e34a05f1123d6630f6f06db6da6b690, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:20,867 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675861400866"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861400866"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861400866"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861400866"}]},"ts":"1675861400866"} 2023-02-08 13:03:20,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=11 2023-02-08 13:03:20,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=11, state=SUCCESS; OpenRegionProcedure 6e34a05f1123d6630f6f06db6da6b690, server=jenkins-hbase4.apache.org,43751,1675861398672 in 245 msec 2023-02-08 13:03:20,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-08 13:03:20,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e34a05f1123d6630f6f06db6da6b690, ASSIGN in 413 msec 2023-02-08 13:03:20,870 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:03:20,871 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861400870"}]},"ts":"1675861400870"} 2023-02-08 13:03:20,871 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-08 13:03:20,873 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:03:20,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 935 msec 2023-02-08 13:03:20,962 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-08 13:03:21,047 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:21,048 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:21,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:21,049 INFO [Listener at localhost/33639] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-08 13:03:21,049 DEBUG [Listener at localhost/33639] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-08 13:03:21,049 INFO [Listener at localhost/33639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:03:21,052 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-08 13:03:21,052 INFO [Listener at localhost/33639] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:03:21,052 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-08 13:03:21,052 INFO [Listener at localhost/33639] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 13:03:21,091 DEBUG [hconnection-0x5d4369f5-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:21,097 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43751] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:21,102 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36336, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:21,111 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40069] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:21,187 INFO [Listener at localhost/33639] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 13:03:21,187 INFO [Listener at localhost/33639] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 13:03:21,188 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:21,188 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:21,189 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-08 13:03:21,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675861401189 (current time:1675861401189). 2023-02-08 13:03:21,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 13:03:21,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] zookeeper.ReadOnlyZKClient(139): Connect 0x1273c703 to 127.0.0.1:51700 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:21,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34d4c77c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:21,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:21,198 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43160, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:21,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1273c703 to 127.0.0.1:51700 2023-02-08 13:03:21,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:21,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 13:03:21,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-08 13:03:21,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-08 13:03:21,203 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-08 13:03:21,204 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675862001204 2023-02-08 13:03:21,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-08 13:03:21,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,205 DEBUG [Listener at localhost/33639] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 13:03:21,206 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-08 13:03:21,206 DEBUG [Listener at localhost/33639] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 13:03:21,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-08 13:03:21,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 4 msec 2023-02-08 13:03:21,208 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-08 13:03:21,208 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1675862001208 2023-02-08 13:03:21,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,226 INFO [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-08 13:03:21,226 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:21,227 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-08 13:03:21,227 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-08 13:03:21,227 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,228 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,229 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:21,229 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:21,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:21,229 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:21,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:21,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:21,229 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,229 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,229 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,229 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:03:21,230 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,230 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-08 13:03:21,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-08 13:03:21,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,230 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-08 13:03:21,230 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-08 13:03:21,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,231 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-08 13:03:21,231 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:21,231 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-08 13:03:21,231 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:21,233 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-08 13:03:21,234 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-08 13:03:21,234 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-08 13:03:21,234 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-08 13:03:21,234 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43751,1675861398672' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-08 13:03:21,234 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40069,1675861398701' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-08 13:03:21,235 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,235 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,235 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:21,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:21,235 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,236 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,236 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:21,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:21,236 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,236 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:21,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:21,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:21,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40069,1675861398701' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-08 13:03:21,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@511e29e5[Count = 1] remaining members to acquire global barrier 2023-02-08 13:03:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:21,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43751,1675861398672' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-08 13:03:21,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@511e29e5[Count = 0] remaining members to acquire global barrier 2023-02-08 13:03:21,240 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-08 13:03:21,240 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,241 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,241 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,241 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-08 13:03:21,241 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-08 13:03:21,241 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,241 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:21,242 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,242 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. started... 2023-02-08 13:03:21,242 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:03:21,242 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:21,242 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. started... 2023-02-08 13:03:21,244 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HRegion(2744): Flushing a483102b691671503ad7e7727d21c140 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:03:21,244 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b4e8cbd16c49c254c64e02f036e9aa71 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-08 13:03:21,248 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:21,248 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. started... 2023-02-08 13:03:21,248 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-08 13:03:21,249 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 13:03:21,249 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-08 13:03:21,249 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 13:03:21,249 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] regionserver.HRegion(2744): Flushing efce11bf79d10a7a0e0ca8c92802c505 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:03:21,249 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:21,249 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. started... 2023-02-08 13:03:21,249 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:21,249 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:21,250 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. started... 2023-02-08 13:03:21,250 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 5fa62d397beda9fc152ed91752b959e2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:03:21,249 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. started... 2023-02-08 13:03:21,251 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] regionserver.HRegion(2744): Flushing f34bf6256167e7e68f1aee5b33d38039 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:03:21,253 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 1dedfa6ce0377768d24a0625a5bf81f6: 2023-02-08 13:03:21,253 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,253 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:21,254 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 13:03:21,254 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 13:03:21,291 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/.tmp/f1/e5e7ea1ce3b947f68e95864ede66541d 2023-02-08 13:03:21,303 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/.tmp/f1/c6e81182180a4ccf9e324d82c989cfbc 2023-02-08 13:03:21,307 DEBUG [Listener at localhost/33639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:21,307 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:21,307 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:21,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-08 13:03:21,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:03:21,309 DEBUG [Listener at localhost/33639] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 13:03:21,319 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. completed. 2023-02-08 13:03:21,319 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:21,319 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:21,319 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. started... 2023-02-08 13:03:21,319 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/.tmp/f1/880d1fd26f5941d8afe2b08bc9173f4c 2023-02-08 13:03:21,320 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 6e34a05f1123d6630f6f06db6da6b690: 2023-02-08 13:03:21,321 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,321 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:21,321 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 13:03:21,319 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-08 13:03:21,321 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-08 13:03:21,325 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/.tmp/f1/2f0090914a254c35832f326d7ea66dcf 2023-02-08 13:03:21,356 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. completed. 2023-02-08 13:03:21,356 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:21,356 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:21,356 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-08 13:03:21,356 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. started... 2023-02-08 13:03:21,366 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/.tmp/f2/3616e1cd449c4b42a8d80457c3c3234f 2023-02-08 13:03:21,381 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] regionserver.HRegion(2744): Flushing af105189d7e976ff1119f2d054c2d629 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:03:21,383 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/.tmp/f1/e5e7ea1ce3b947f68e95864ede66541d as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1/e5e7ea1ce3b947f68e95864ede66541d 2023-02-08 13:03:21,384 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/.tmp/f2/3ee8346a8a63453fa89634710fa0d539 2023-02-08 13:03:21,391 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/.tmp/f1/880d1fd26f5941d8afe2b08bc9173f4c as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1/880d1fd26f5941d8afe2b08bc9173f4c 2023-02-08 13:03:21,398 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1/e5e7ea1ce3b947f68e95864ede66541d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 13:03:21,399 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/.tmp/f2/3616e1cd449c4b42a8d80457c3c3234f as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2/3616e1cd449c4b42a8d80457c3c3234f 2023-02-08 13:03:21,404 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2/3616e1cd449c4b42a8d80457c3c3234f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 13:03:21,404 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/.tmp/f2/b63b01ed02f7448f8ba4b6f562ca0246 2023-02-08 13:03:21,405 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1/880d1fd26f5941d8afe2b08bc9173f4c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:21,405 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for b4e8cbd16c49c254c64e02f036e9aa71 in 161ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:21,405 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-08 13:03:21,406 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/.tmp/f2/3ee8346a8a63453fa89634710fa0d539 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2/3ee8346a8a63453fa89634710fa0d539 2023-02-08 13:03:21,406 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b4e8cbd16c49c254c64e02f036e9aa71: 2023-02-08 13:03:21,406 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,406 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:21,406 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1/e5e7ea1ce3b947f68e95864ede66541d] hfiles 2023-02-08 13:03:21,406 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1/e5e7ea1ce3b947f68e95864ede66541d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,406 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2/3616e1cd449c4b42a8d80457c3c3234f] hfiles 2023-02-08 13:03:21,406 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2/3616e1cd449c4b42a8d80457c3c3234f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,416 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/.tmp/f2/146487b65e5c44fcaf669d1e8cb26bdf 2023-02-08 13:03:21,420 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/.tmp/f1/c6e81182180a4ccf9e324d82c989cfbc as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1/c6e81182180a4ccf9e324d82c989cfbc 2023-02-08 13:03:21,422 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2/3ee8346a8a63453fa89634710fa0d539, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:21,422 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a483102b691671503ad7e7727d21c140 in 178ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:21,425 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a483102b691671503ad7e7727d21c140: 2023-02-08 13:03:21,425 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,428 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:21,428 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1/880d1fd26f5941d8afe2b08bc9173f4c] hfiles 2023-02-08 13:03:21,428 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1/880d1fd26f5941d8afe2b08bc9173f4c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,428 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2/3ee8346a8a63453fa89634710fa0d539] hfiles 2023-02-08 13:03:21,428 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2/3ee8346a8a63453fa89634710fa0d539 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,430 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/.tmp/f1/2f0090914a254c35832f326d7ea66dcf as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1/2f0090914a254c35832f326d7ea66dcf 2023-02-08 13:03:21,431 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1/c6e81182180a4ccf9e324d82c989cfbc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:21,432 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/.tmp/f2/b63b01ed02f7448f8ba4b6f562ca0246 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2/b63b01ed02f7448f8ba4b6f562ca0246 2023-02-08 13:03:21,435 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1/2f0090914a254c35832f326d7ea66dcf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:21,436 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/.tmp/f2/146487b65e5c44fcaf669d1e8cb26bdf as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2/146487b65e5c44fcaf669d1e8cb26bdf 2023-02-08 13:03:21,437 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2/b63b01ed02f7448f8ba4b6f562ca0246, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:21,438 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for efce11bf79d10a7a0e0ca8c92802c505 in 189ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:21,438 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for efce11bf79d10a7a0e0ca8c92802c505: 2023-02-08 13:03:21,438 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,438 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:21,438 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1/c6e81182180a4ccf9e324d82c989cfbc] hfiles 2023-02-08 13:03:21,438 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1/c6e81182180a4ccf9e324d82c989cfbc for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,438 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2/b63b01ed02f7448f8ba4b6f562ca0246] hfiles 2023-02-08 13:03:21,438 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2/b63b01ed02f7448f8ba4b6f562ca0246 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,442 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2/146487b65e5c44fcaf669d1e8cb26bdf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:21,442 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5fa62d397beda9fc152ed91752b959e2 in 192ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:21,443 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5fa62d397beda9fc152ed91752b959e2: 2023-02-08 13:03:21,443 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,443 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:21,443 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1/2f0090914a254c35832f326d7ea66dcf] hfiles 2023-02-08 13:03:21,443 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1/2f0090914a254c35832f326d7ea66dcf for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,443 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2/146487b65e5c44fcaf669d1e8cb26bdf] hfiles 2023-02-08 13:03:21,443 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2/146487b65e5c44fcaf669d1e8cb26bdf for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,444 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. completed. 2023-02-08 13:03:21,444 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:21,444 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-08 13:03:21,444 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/.tmp/f1/0de744fd111e49ce96c91eeec1489344 2023-02-08 13:03:21,461 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. completed. 2023-02-08 13:03:21,461 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:21,461 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:21,463 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. started... 2023-02-08 13:03:21,461 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-08 13:03:21,464 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b0affe31618e6bfe674fdedfa4e15968 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-08 13:03:21,476 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. completed. 2023-02-08 13:03:21,476 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:21,476 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:21,476 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-08 13:03:21,476 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. started... 2023-02-08 13:03:21,477 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 14b62f8b8e0b4b3a0a607fbbaafc0d01 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-08 13:03:21,496 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/.tmp/f1/d2574f74eab94061bec46d7f85d13744 2023-02-08 13:03:21,497 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/.tmp/f2/0b13c3b705a44294b0072f1f498d5180 2023-02-08 13:03:21,503 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/.tmp/f1/0de744fd111e49ce96c91eeec1489344 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1/0de744fd111e49ce96c91eeec1489344 2023-02-08 13:03:21,509 DEBUG [Listener at localhost/33639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:21,509 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:21,509 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:21,510 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1/0de744fd111e49ce96c91eeec1489344, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:21,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-08 13:03:21,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:03:21,510 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/.tmp/f2/0b13c3b705a44294b0072f1f498d5180 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2/0b13c3b705a44294b0072f1f498d5180 2023-02-08 13:03:21,511 DEBUG [Listener at localhost/33639] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-08 13:03:21,512 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/.tmp/f1/7b4097d4ec344243ab0ac7ce3c84cf0e 2023-02-08 13:03:21,515 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2/0b13c3b705a44294b0072f1f498d5180, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:21,516 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for af105189d7e976ff1119f2d054c2d629 in 135ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:21,516 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for af105189d7e976ff1119f2d054c2d629: 2023-02-08 13:03:21,517 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,517 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:21,517 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1/0de744fd111e49ce96c91eeec1489344] hfiles 2023-02-08 13:03:21,517 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1/0de744fd111e49ce96c91eeec1489344 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,517 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2/0b13c3b705a44294b0072f1f498d5180] hfiles 2023-02-08 13:03:21,517 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2/0b13c3b705a44294b0072f1f498d5180 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,534 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. completed. 2023-02-08 13:03:21,534 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:21,534 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-08 13:03:21,536 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/.tmp/f2/de7160c650e748c4bc072d50cf757fc7 2023-02-08 13:03:21,540 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/.tmp/f1/7b4097d4ec344243ab0ac7ce3c84cf0e as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1/7b4097d4ec344243ab0ac7ce3c84cf0e 2023-02-08 13:03:21,544 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1/7b4097d4ec344243ab0ac7ce3c84cf0e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:21,544 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/.tmp/f2/de7160c650e748c4bc072d50cf757fc7 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2/de7160c650e748c4bc072d50cf757fc7 2023-02-08 13:03:21,548 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2/de7160c650e748c4bc072d50cf757fc7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:21,549 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 14b62f8b8e0b4b3a0a607fbbaafc0d01 in 72ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:21,549 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 14b62f8b8e0b4b3a0a607fbbaafc0d01: 2023-02-08 13:03:21,549 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,549 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:21,549 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1/7b4097d4ec344243ab0ac7ce3c84cf0e] hfiles 2023-02-08 13:03:21,549 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1/7b4097d4ec344243ab0ac7ce3c84cf0e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,550 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2/de7160c650e748c4bc072d50cf757fc7] hfiles 2023-02-08 13:03:21,550 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2/de7160c650e748c4bc072d50cf757fc7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,558 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. completed. 2023-02-08 13:03:21,558 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:21,558 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-08 13:03:21,710 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/.tmp/f1/b53adea9d4c34bde9ec50714001cafa2 2023-02-08 13:03:21,729 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/.tmp/f2/dbf71a0252b148c6a53bb5c653743f01 2023-02-08 13:03:21,733 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/.tmp/f1/b53adea9d4c34bde9ec50714001cafa2 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1/b53adea9d4c34bde9ec50714001cafa2 2023-02-08 13:03:21,737 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1/b53adea9d4c34bde9ec50714001cafa2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:21,738 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/.tmp/f2/dbf71a0252b148c6a53bb5c653743f01 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2/dbf71a0252b148c6a53bb5c653743f01 2023-02-08 13:03:21,742 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2/dbf71a0252b148c6a53bb5c653743f01, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-08 13:03:21,743 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f34bf6256167e7e68f1aee5b33d38039 in 492ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:21,743 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f34bf6256167e7e68f1aee5b33d38039: 2023-02-08 13:03:21,743 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,743 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:21,743 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1/b53adea9d4c34bde9ec50714001cafa2] hfiles 2023-02-08 13:03:21,743 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1/b53adea9d4c34bde9ec50714001cafa2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,743 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2/dbf71a0252b148c6a53bb5c653743f01] hfiles 2023-02-08 13:03:21,743 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2/dbf71a0252b148c6a53bb5c653743f01 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,748 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. completed. 2023-02-08 13:03:21,748 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:21,748 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-08 13:03:21,811 DEBUG [Listener at localhost/33639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:21,811 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:21,811 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:21,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-08 13:03:21,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:03:21,812 DEBUG [Listener at localhost/33639] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-08 13:03:21,892 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. completed. 2023-02-08 13:03:21,892 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:21,892 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-08 13:03:21,892 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-08 13:03:21,892 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,892 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-08 13:03:21,893 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43751,1675861398672' in zk 2023-02-08 13:03:21,895 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-08 13:03:21,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:21,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-08 13:03:21,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:21,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:21,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43751,1675861398672': 2023-02-08 13:03:21,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43751,1675861398672' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-08 13:03:21,920 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/.tmp/f2/55e0257f726640e6ac1ef9c92fe868ec 2023-02-08 13:03:21,925 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/.tmp/f1/d2574f74eab94061bec46d7f85d13744 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1/d2574f74eab94061bec46d7f85d13744 2023-02-08 13:03:21,929 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1/d2574f74eab94061bec46d7f85d13744, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 13:03:21,929 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/.tmp/f2/55e0257f726640e6ac1ef9c92fe868ec as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2/55e0257f726640e6ac1ef9c92fe868ec 2023-02-08 13:03:21,932 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2/55e0257f726640e6ac1ef9c92fe868ec, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-08 13:03:21,933 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for b0affe31618e6bfe674fdedfa4e15968 in 469ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:21,933 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b0affe31618e6bfe674fdedfa4e15968: 2023-02-08 13:03:21,933 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,933 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:21,934 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1/d2574f74eab94061bec46d7f85d13744] hfiles 2023-02-08 13:03:21,934 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1/d2574f74eab94061bec46d7f85d13744 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,934 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2/55e0257f726640e6ac1ef9c92fe868ec] hfiles 2023-02-08 13:03:21,934 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2/55e0257f726640e6ac1ef9c92fe868ec for snapshot=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,939 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. completed. 2023-02-08 13:03:21,939 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:21,939 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-08 13:03:21,939 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-08 13:03:21,939 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,939 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-08 13:03:21,939 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40069,1675861398701' in zk 2023-02-08 13:03:21,941 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-08 13:03:21,941 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:21,941 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,941 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-08 13:03:21,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:21,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:21,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:21,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:21,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:21,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40069,1675861398701': 2023-02-08 13:03:21,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40069,1675861398701' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-08 13:03:21,944 INFO [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-08 13:03:21,944 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:03:21,944 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:03:21,944 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,944 INFO [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 13:03:21,945 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,945 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,945 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:21,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:21,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,945 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,945 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:21,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:21,946 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,946 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:21,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,947 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:21,948 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,953 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,953 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:21,953 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:21,953 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:21,953 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:21,953 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:21,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,953 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:21,953 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:21,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:21,954 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:21,954 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,954 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:21,954 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,954 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:21,954 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,954 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:21,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:21,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:21,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:21,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:21,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,010 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-08 13:03:22,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,010 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1675861401204Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1675861401953 (+749 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1675861401954 (+1 ms)Writing data manifest for testWithMockedMapReduceMultiRegion at 1675861401962 (+8 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1675861401976 (+14 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1675861402010 (+34 ms) 2023-02-08 13:03:22,012 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-08 13:03:22,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 807 msec 2023-02-08 13:03:22,312 DEBUG [Listener at localhost/33639] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:22,313 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:22,313 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:22,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-08 13:03:22,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 13:03:22,314 INFO [Listener at localhost/33639] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 13:03:22,314 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:22,314 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:22,318 INFO [Listener at localhost/33639] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 13:03:22,323 INFO [Listener at localhost/33639] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 13:03:22,344 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43751] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:22,349 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40069] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:22,409 INFO [Listener at localhost/33639] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 13:03:22,413 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:22,413 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:22,415 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 13:03:22,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,418 INFO [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-08 13:03:22,418 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:22,419 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-08 13:03:22,419 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-08 13:03:22,419 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,419 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,420 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:22,420 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:22,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:22,420 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:22,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:22,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:22,421 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,421 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,421 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,421 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:03:22,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:03:22,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:03:22,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,422 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,422 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,422 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-08 13:03:22,422 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:22,425 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-08 13:03:22,425 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-08 13:03:22,425 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:22,425 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-08 13:03:22,425 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:22,425 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. started... 2023-02-08 13:03:22,425 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:22,425 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-08 13:03:22,425 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:22,426 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 13:03:22,425 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a483102b691671503ad7e7727d21c140 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:03:22,425 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. started... 2023-02-08 13:03:22,425 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:22,426 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. started... 2023-02-08 13:03:22,426 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. started... 2023-02-08 13:03:22,426 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 5fa62d397beda9fc152ed91752b959e2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:03:22,426 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f34bf6256167e7e68f1aee5b33d38039 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:03:22,426 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b4e8cbd16c49c254c64e02f036e9aa71 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-08 13:03:22,428 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:22,428 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. started... 2023-02-08 13:03:22,428 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing efce11bf79d10a7a0e0ca8c92802c505 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:03:22,432 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-08 13:03:22,433 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 13:03:22,433 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:22,433 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. started... 2023-02-08 13:03:22,433 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1dedfa6ce0377768d24a0625a5bf81f6: 2023-02-08 13:03:22,433 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:22,433 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:22,433 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-08 13:03:22,433 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. started... 2023-02-08 13:03:22,434 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6e34a05f1123d6630f6f06db6da6b690: 2023-02-08 13:03:22,434 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:22,434 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:22,434 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. started... 2023-02-08 13:03:22,434 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-08 13:03:22,434 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing af105189d7e976ff1119f2d054c2d629 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:03:22,456 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/.tmp/f1/ca114ea02de045ccae123af66a38e667 2023-02-08 13:03:22,480 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/.tmp/f1/f5e33f40b3b94797b1e2c9496fcab368 2023-02-08 13:03:22,484 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/.tmp/f1/94f75decce31492e821393938e809f3e 2023-02-08 13:03:22,484 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/.tmp/f1/08a81b0941644c56b86cfb5a81cda73a 2023-02-08 13:03:22,485 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/.tmp/f1/00a1b1a191cf43c2b771f4fe067e3a2e 2023-02-08 13:03:22,486 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/.tmp/f1/5645e6bf911e4bb5b92ab5119e735258 2023-02-08 13:03:22,490 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/.tmp/f2/aec40c5b28604e50abb40277d193ff1c 2023-02-08 13:03:22,505 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/.tmp/f1/ca114ea02de045ccae123af66a38e667 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1/ca114ea02de045ccae123af66a38e667 2023-02-08 13:03:22,509 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1/ca114ea02de045ccae123af66a38e667, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:22,509 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/.tmp/f2/aec40c5b28604e50abb40277d193ff1c as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2/aec40c5b28604e50abb40277d193ff1c 2023-02-08 13:03:22,513 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2/aec40c5b28604e50abb40277d193ff1c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:22,514 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for efce11bf79d10a7a0e0ca8c92802c505 in 86ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:22,514 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for efce11bf79d10a7a0e0ca8c92802c505: 2023-02-08 13:03:22,514 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:22,514 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-08 13:03:22,538 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/.tmp/f2/3ce77d5fce5a4ab1a2bd3e97cb29f8f3 2023-02-08 13:03:22,540 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/.tmp/f2/37bcce66432b4b2baa066344c688886b 2023-02-08 13:03:22,540 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/.tmp/f2/cbb4764ea5da4ab8a5e089a0e72c08e9 2023-02-08 13:03:22,540 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/.tmp/f2/bba2338b2f2d4955bd99cb79aa2daf11 2023-02-08 13:03:22,544 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/.tmp/f2/791ad15a78a2447a8208da136e611288 2023-02-08 13:03:22,544 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/.tmp/f1/94f75decce31492e821393938e809f3e as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1/94f75decce31492e821393938e809f3e 2023-02-08 13:03:22,546 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/.tmp/f1/5645e6bf911e4bb5b92ab5119e735258 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1/5645e6bf911e4bb5b92ab5119e735258 2023-02-08 13:03:22,546 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/.tmp/f1/08a81b0941644c56b86cfb5a81cda73a as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1/08a81b0941644c56b86cfb5a81cda73a 2023-02-08 13:03:22,548 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/.tmp/f1/f5e33f40b3b94797b1e2c9496fcab368 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1/f5e33f40b3b94797b1e2c9496fcab368 2023-02-08 13:03:22,551 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1/94f75decce31492e821393938e809f3e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:22,553 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/.tmp/f1/00a1b1a191cf43c2b771f4fe067e3a2e as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1/00a1b1a191cf43c2b771f4fe067e3a2e 2023-02-08 13:03:22,554 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1/5645e6bf911e4bb5b92ab5119e735258, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 13:03:22,554 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1/08a81b0941644c56b86cfb5a81cda73a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:22,555 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/.tmp/f2/3ce77d5fce5a4ab1a2bd3e97cb29f8f3 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2/3ce77d5fce5a4ab1a2bd3e97cb29f8f3 2023-02-08 13:03:22,555 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/.tmp/f2/bba2338b2f2d4955bd99cb79aa2daf11 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2/bba2338b2f2d4955bd99cb79aa2daf11 2023-02-08 13:03:22,555 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/.tmp/f2/37bcce66432b4b2baa066344c688886b as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2/37bcce66432b4b2baa066344c688886b 2023-02-08 13:03:22,556 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1/f5e33f40b3b94797b1e2c9496fcab368, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:22,557 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/.tmp/f2/cbb4764ea5da4ab8a5e089a0e72c08e9 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2/cbb4764ea5da4ab8a5e089a0e72c08e9 2023-02-08 13:03:22,560 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1/00a1b1a191cf43c2b771f4fe067e3a2e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:22,561 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2/bba2338b2f2d4955bd99cb79aa2daf11, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 13:03:22,561 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/.tmp/f2/791ad15a78a2447a8208da136e611288 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2/791ad15a78a2447a8208da136e611288 2023-02-08 13:03:22,562 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2/cbb4764ea5da4ab8a5e089a0e72c08e9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:22,562 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for b4e8cbd16c49c254c64e02f036e9aa71 in 136ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:22,562 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2/37bcce66432b4b2baa066344c688886b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:22,563 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b4e8cbd16c49c254c64e02f036e9aa71: 2023-02-08 13:03:22,563 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f34bf6256167e7e68f1aee5b33d38039 in 137ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:22,563 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:22,563 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f34bf6256167e7e68f1aee5b33d38039: 2023-02-08 13:03:22,563 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:22,563 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:22,563 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. started... 2023-02-08 13:03:22,563 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-08 13:03:22,563 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b0affe31618e6bfe674fdedfa4e15968 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-08 13:03:22,563 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-08 13:03:22,563 INFO [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for af105189d7e976ff1119f2d054c2d629 in 129ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:22,563 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for af105189d7e976ff1119f2d054c2d629: 2023-02-08 13:03:22,563 DEBUG [rs(jenkins-hbase4.apache.org,43751,1675861398672)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:22,563 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-08 13:03:22,563 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-08 13:03:22,563 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,564 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-08 13:03:22,564 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43751,1675861398672' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-08 13:03:22,565 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2/3ce77d5fce5a4ab1a2bd3e97cb29f8f3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:22,566 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a483102b691671503ad7e7727d21c140 in 141ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:22,566 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a483102b691671503ad7e7727d21c140: 2023-02-08 13:03:22,566 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:22,566 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-08 13:03:22,566 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. started... 2023-02-08 13:03:22,566 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 14b62f8b8e0b4b3a0a607fbbaafc0d01 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-08 13:03:22,566 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,566 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:22,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:22,567 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,567 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:22,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:22,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:22,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:22,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43751,1675861398672' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-08 13:03:22,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5521b71e[Count = 1] remaining members to acquire global barrier 2023-02-08 13:03:22,573 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2/791ad15a78a2447a8208da136e611288, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:22,574 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5fa62d397beda9fc152ed91752b959e2 in 148ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:22,574 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5fa62d397beda9fc152ed91752b959e2: 2023-02-08 13:03:22,574 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:22,574 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-08 13:03:22,584 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/.tmp/f1/640084068fe04bbb90889b972da2fbfb 2023-02-08 13:03:22,586 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/.tmp/f1/096120138ba0445aa48e7ce17439827a 2023-02-08 13:03:22,608 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/.tmp/f2/572f3f4865804be0b932a15265c6dc54 2023-02-08 13:03:22,612 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/.tmp/f1/640084068fe04bbb90889b972da2fbfb as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1/640084068fe04bbb90889b972da2fbfb 2023-02-08 13:03:22,616 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/.tmp/f2/1c027c19e86e4d97946ffe7325606f6a 2023-02-08 13:03:22,619 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1/640084068fe04bbb90889b972da2fbfb, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 13:03:22,620 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/.tmp/f2/572f3f4865804be0b932a15265c6dc54 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2/572f3f4865804be0b932a15265c6dc54 2023-02-08 13:03:22,623 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/.tmp/f1/096120138ba0445aa48e7ce17439827a as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1/096120138ba0445aa48e7ce17439827a 2023-02-08 13:03:22,626 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2/572f3f4865804be0b932a15265c6dc54, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-08 13:03:22,627 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for b0affe31618e6bfe674fdedfa4e15968 in 63ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:22,627 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b0affe31618e6bfe674fdedfa4e15968: 2023-02-08 13:03:22,627 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:22,627 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-08 13:03:22,628 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1/096120138ba0445aa48e7ce17439827a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:22,629 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/.tmp/f2/1c027c19e86e4d97946ffe7325606f6a as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2/1c027c19e86e4d97946ffe7325606f6a 2023-02-08 13:03:22,633 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2/1c027c19e86e4d97946ffe7325606f6a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-08 13:03:22,633 INFO [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 14b62f8b8e0b4b3a0a607fbbaafc0d01 in 67ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:22,633 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 14b62f8b8e0b4b3a0a607fbbaafc0d01: 2023-02-08 13:03:22,633 DEBUG [rs(jenkins-hbase4.apache.org,40069,1675861398701)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:22,633 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-08 13:03:22,633 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-08 13:03:22,634 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,634 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-08 13:03:22,634 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40069,1675861398701' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-08 13:03:22,635 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,635 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:22,635 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,635 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:22,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:22,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:22,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40069,1675861398701' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-08 13:03:22,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5521b71e[Count = 0] remaining members to acquire global barrier 2023-02-08 13:03:22,637 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-08 13:03:22,637 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,638 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,638 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,638 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,638 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-08 13:03:22,639 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-08 13:03:22,639 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-08 13:03:22,639 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-08 13:03:22,639 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43751,1675861398672' in zk 2023-02-08 13:03:22,639 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40069,1675861398701' in zk 2023-02-08 13:03:22,639 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,639 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:03:22,640 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,640 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-08 13:03:22,640 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-08 13:03:22,640 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:22,640 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:22,640 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,640 DEBUG [member: 'jenkins-hbase4.apache.org,40069,1675861398701' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-08 13:03:22,640 DEBUG [member: 'jenkins-hbase4.apache.org,43751,1675861398672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-08 13:03:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:22,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43751,1675861398672': 2023-02-08 13:03:22,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43751,1675861398672' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-08 13:03:22,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:22,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:22,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:22,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40069,1675861398701': 2023-02-08 13:03:22,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40069,1675861398701' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-08 13:03:22,646 INFO [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-08 13:03:22,646 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:03:22,646 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:03:22,646 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,646 INFO [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 13:03:22,648 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,648 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,648 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:22,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,648 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:22,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,648 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,649 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:22,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,649 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:22,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,651 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:22,651 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,653 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:22,653 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,653 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:22,653 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:22,653 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-08 13:03:22,654 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 13:03:22,653 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,653 DEBUG [(jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:22,653 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:22,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:22,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:22,653 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:22,654 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,654 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:22,654 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,654 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:22,654 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,654 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:22,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:22,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:22,654 DEBUG [Listener at localhost/33639] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-08 13:03:22,654 DEBUG [Listener at localhost/33639] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 13:03:22,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:22,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:22,755 DEBUG [Listener at localhost/33639] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 13:03:22,755 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:22,755 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:22,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 13:03:22,761 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675861401189 type: FLUSH version: 2 ttl: 0 2023-02-08 13:03:22,761 DEBUG [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,762 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(239): region to add: a483102b691671503ad7e7727d21c140 2023-02-08 13:03:22,762 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(239): region to add: b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:22,762 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(239): region to add: 1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:22,762 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(239): region to add: efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:22,762 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(239): region to add: 6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:22,762 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(239): region to add: 5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:22,762 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(239): region to add: f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:22,762 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(239): region to add: 14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:22,763 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(239): region to add: b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:22,763 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(239): region to add: af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:22,763 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(585): clone region=a483102b691671503ad7e7727d21c140 as a483102b691671503ad7e7727d21c140 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,763 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(585): clone region=b4e8cbd16c49c254c64e02f036e9aa71 as b4e8cbd16c49c254c64e02f036e9aa71 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,763 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(585): clone region=1dedfa6ce0377768d24a0625a5bf81f6 as 1dedfa6ce0377768d24a0625a5bf81f6 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,763 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(585): clone region=efce11bf79d10a7a0e0ca8c92802c505 as efce11bf79d10a7a0e0ca8c92802c505 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,763 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(585): clone region=6e34a05f1123d6630f6f06db6da6b690 as 6e34a05f1123d6630f6f06db6da6b690 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,763 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(585): clone region=5fa62d397beda9fc152ed91752b959e2 as 5fa62d397beda9fc152ed91752b959e2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,763 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(585): clone region=f34bf6256167e7e68f1aee5b33d38039 as f34bf6256167e7e68f1aee5b33d38039 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,763 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(585): clone region=14b62f8b8e0b4b3a0a607fbbaafc0d01 as 14b62f8b8e0b4b3a0a607fbbaafc0d01 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,763 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(585): clone region=b0affe31618e6bfe674fdedfa4e15968 as b0affe31618e6bfe674fdedfa4e15968 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,763 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(585): clone region=af105189d7e976ff1119f2d054c2d629 as af105189d7e976ff1119f2d054c2d629 in snapshot testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,765 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 14b62f8b8e0b4b3a0a607fbbaafc0d01, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8 2023-02-08 13:03:22,766 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 5fa62d397beda9fc152ed91752b959e2, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8 2023-02-08 13:03:22,766 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => a483102b691671503ad7e7727d21c140, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8 2023-02-08 13:03:22,766 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 6e34a05f1123d6630f6f06db6da6b690, NAME => 'testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8 2023-02-08 13:03:22,766 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1dedfa6ce0377768d24a0625a5bf81f6, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8 2023-02-08 13:03:22,766 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => b4e8cbd16c49c254c64e02f036e9aa71, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8 2023-02-08 13:03:22,766 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => f34bf6256167e7e68f1aee5b33d38039, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8 2023-02-08 13:03:22,766 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => efce11bf79d10a7a0e0ca8c92802c505, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8 2023-02-08 13:03:22,792 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:22,792 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b53adea9d4c34bde9ec50714001cafa2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,808 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:22,808 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e5e7ea1ce3b947f68e95864ede66541d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,809 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:22,809 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 1dedfa6ce0377768d24a0625a5bf81f6, disabling compactions & flushes 2023-02-08 13:03:22,809 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:22,809 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:22,810 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. after waiting 0 ms 2023-02-08 13:03:22,810 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:22,810 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:22,810 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 1dedfa6ce0377768d24a0625a5bf81f6: Waiting for close lock at 1675861402809Disabling compacts and flushes for region at 1675861402809Disabling writes for close at 1675861402810 (+1 ms)Writing region close event to WAL at 1675861402810Closed at 1675861402810 2023-02-08 13:03:22,810 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dbf71a0252b148c6a53bb5c653743f01 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,810 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => b0affe31618e6bfe674fdedfa4e15968, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8 2023-02-08 13:03:22,811 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:22,811 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2f0090914a254c35832f326d7ea66dcf from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,823 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3616e1cd449c4b42a8d80457c3c3234f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,824 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 146487b65e5c44fcaf669d1e8cb26bdf from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,830 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:22,830 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c6e81182180a4ccf9e324d82c989cfbc from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,830 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:22,830 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 880d1fd26f5941d8afe2b08bc9173f4c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,831 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing f34bf6256167e7e68f1aee5b33d38039, disabling compactions & flushes 2023-02-08 13:03:22,831 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:22,831 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:22,831 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. after waiting 0 ms 2023-02-08 13:03:22,831 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:22,831 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:22,831 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for f34bf6256167e7e68f1aee5b33d38039: Waiting for close lock at 1675861402831Disabling compacts and flushes for region at 1675861402831Disabling writes for close at 1675861402831Writing region close event to WAL at 1675861402831Closed at 1675861402831 2023-02-08 13:03:22,832 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => af105189d7e976ff1119f2d054c2d629, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8 2023-02-08 13:03:22,833 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:22,833 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:22,833 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 6e34a05f1123d6630f6f06db6da6b690, disabling compactions & flushes 2023-02-08 13:03:22,833 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7b4097d4ec344243ab0ac7ce3c84cf0e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,833 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing b4e8cbd16c49c254c64e02f036e9aa71, disabling compactions & flushes 2023-02-08 13:03:22,833 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:22,833 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:22,833 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:22,833 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:22,833 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. after waiting 0 ms 2023-02-08 13:03:22,833 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. after waiting 0 ms 2023-02-08 13:03:22,833 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:22,833 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:22,833 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:22,833 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for b4e8cbd16c49c254c64e02f036e9aa71: Waiting for close lock at 1675861402833Disabling compacts and flushes for region at 1675861402833Disabling writes for close at 1675861402833Writing region close event to WAL at 1675861402833Closed at 1675861402833 2023-02-08 13:03:22,833 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:22,834 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 6e34a05f1123d6630f6f06db6da6b690: Waiting for close lock at 1675861402833Disabling compacts and flushes for region at 1675861402833Disabling writes for close at 1675861402833Writing region close event to WAL at 1675861402833Closed at 1675861402833 2023-02-08 13:03:22,834 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 5fa62d397beda9fc152ed91752b959e2, disabling compactions & flushes 2023-02-08 13:03:22,834 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:22,834 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:22,836 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. after waiting 2 ms 2023-02-08 13:03:22,836 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:22,836 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:22,836 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 5fa62d397beda9fc152ed91752b959e2: Waiting for close lock at 1675861402834Disabling compacts and flushes for region at 1675861402834Disabling writes for close at 1675861402836 (+2 ms)Writing region close event to WAL at 1675861402836Closed at 1675861402836 2023-02-08 13:03:22,845 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3ee8346a8a63453fa89634710fa0d539 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,845 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink de7160c650e748c4bc072d50cf757fc7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,852 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b63b01ed02f7448f8ba4b6f562ca0246 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,853 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 14b62f8b8e0b4b3a0a607fbbaafc0d01, disabling compactions & flushes 2023-02-08 13:03:22,853 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:22,853 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:22,853 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:22,853 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d2574f74eab94061bec46d7f85d13744 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,853 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. after waiting 0 ms 2023-02-08 13:03:22,853 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing a483102b691671503ad7e7727d21c140, disabling compactions & flushes 2023-02-08 13:03:22,853 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:22,853 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:22,853 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:22,854 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. after waiting 0 ms 2023-02-08 13:03:22,854 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:22,854 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:22,854 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for a483102b691671503ad7e7727d21c140: Waiting for close lock at 1675861402853Disabling compacts and flushes for region at 1675861402853Disabling writes for close at 1675861402854 (+1 ms)Writing region close event to WAL at 1675861402854Closed at 1675861402854 2023-02-08 13:03:22,854 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:22,854 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 14b62f8b8e0b4b3a0a607fbbaafc0d01: Waiting for close lock at 1675861402853Disabling compacts and flushes for region at 1675861402853Disabling writes for close at 1675861402853Writing region close event to WAL at 1675861402854 (+1 ms)Closed at 1675861402854 2023-02-08 13:03:22,860 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing efce11bf79d10a7a0e0ca8c92802c505, disabling compactions & flushes 2023-02-08 13:03:22,860 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:22,860 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:22,860 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. after waiting 0 ms 2023-02-08 13:03:22,860 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:22,860 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:22,860 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for efce11bf79d10a7a0e0ca8c92802c505: Waiting for close lock at 1675861402860Disabling compacts and flushes for region at 1675861402860Disabling writes for close at 1675861402860Writing region close event to WAL at 1675861402860Closed at 1675861402860 2023-02-08 13:03:22,860 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 55e0257f726640e6ac1ef9c92fe868ec from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,862 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing b0affe31618e6bfe674fdedfa4e15968, disabling compactions & flushes 2023-02-08 13:03:22,862 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:22,862 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:22,862 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. after waiting 0 ms 2023-02-08 13:03:22,863 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:22,863 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:22,863 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for b0affe31618e6bfe674fdedfa4e15968: Waiting for close lock at 1675861402862Disabling compacts and flushes for region at 1675861402862Disabling writes for close at 1675861402863 (+1 ms)Writing region close event to WAL at 1675861402863Closed at 1675861402863 2023-02-08 13:03:22,863 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:22,863 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0de744fd111e49ce96c91eeec1489344 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,865 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0b13c3b705a44294b0072f1f498d5180 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:22,867 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing af105189d7e976ff1119f2d054c2d629, disabling compactions & flushes 2023-02-08 13:03:22,867 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:22,867 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:22,867 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. after waiting 0 ms 2023-02-08 13:03:22,867 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:22,867 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:22,867 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for af105189d7e976ff1119f2d054c2d629: Waiting for close lock at 1675861402867Disabling compacts and flushes for region at 1675861402867Disabling writes for close at 1675861402867Writing region close event to WAL at 1675861402867Closed at 1675861402867 2023-02-08 13:03:22,868 INFO [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675861401189 type: FLUSH version: 2 ttl: 0 2023-02-08 13:03:22,868 DEBUG [Listener at localhost/33639] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8 2023-02-08 13:03:22,868 DEBUG [Listener at localhost/33639] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8 2023-02-08 13:03:22,868 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-data/ 2023-02-08 13:03:22,869 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |----default/ 2023-02-08 13:03:22,869 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-08 13:03:22,870 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |----------14b62f8b8e0b4b3a0a607fbbaafc0d01/ 2023-02-08 13:03:22,870 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:22,870 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:22,870 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=14b62f8b8e0b4b3a0a607fbbaafc0d01-7b4097d4ec344243ab0ac7ce3c84cf0e 2023-02-08 13:03:22,870 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:22,871 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=14b62f8b8e0b4b3a0a607fbbaafc0d01-de7160c650e748c4bc072d50cf757fc7 2023-02-08 13:03:22,871 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |----------1dedfa6ce0377768d24a0625a5bf81f6/ 2023-02-08 13:03:22,871 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:22,871 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |----------5fa62d397beda9fc152ed91752b959e2/ 2023-02-08 13:03:22,872 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:22,872 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:22,872 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5fa62d397beda9fc152ed91752b959e2-2f0090914a254c35832f326d7ea66dcf 2023-02-08 13:03:22,872 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:22,873 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5fa62d397beda9fc152ed91752b959e2-146487b65e5c44fcaf669d1e8cb26bdf 2023-02-08 13:03:22,873 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |----------6e34a05f1123d6630f6f06db6da6b690/ 2023-02-08 13:03:22,873 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:22,873 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |----------a483102b691671503ad7e7727d21c140/ 2023-02-08 13:03:22,873 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:22,874 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:22,874 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=a483102b691671503ad7e7727d21c140-880d1fd26f5941d8afe2b08bc9173f4c 2023-02-08 13:03:22,874 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:22,875 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=a483102b691671503ad7e7727d21c140-3ee8346a8a63453fa89634710fa0d539 2023-02-08 13:03:22,875 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |----------af105189d7e976ff1119f2d054c2d629/ 2023-02-08 13:03:22,875 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:22,875 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:22,875 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=af105189d7e976ff1119f2d054c2d629-0de744fd111e49ce96c91eeec1489344 2023-02-08 13:03:22,876 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:22,876 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=af105189d7e976ff1119f2d054c2d629-0b13c3b705a44294b0072f1f498d5180 2023-02-08 13:03:22,876 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |----------b0affe31618e6bfe674fdedfa4e15968/ 2023-02-08 13:03:22,877 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:22,877 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:22,877 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b0affe31618e6bfe674fdedfa4e15968-d2574f74eab94061bec46d7f85d13744 2023-02-08 13:03:22,877 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:22,877 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b0affe31618e6bfe674fdedfa4e15968-55e0257f726640e6ac1ef9c92fe868ec 2023-02-08 13:03:22,878 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |----------b4e8cbd16c49c254c64e02f036e9aa71/ 2023-02-08 13:03:22,878 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:22,878 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:22,878 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b4e8cbd16c49c254c64e02f036e9aa71-e5e7ea1ce3b947f68e95864ede66541d 2023-02-08 13:03:22,878 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:22,879 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b4e8cbd16c49c254c64e02f036e9aa71-3616e1cd449c4b42a8d80457c3c3234f 2023-02-08 13:03:22,879 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |----------efce11bf79d10a7a0e0ca8c92802c505/ 2023-02-08 13:03:22,879 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:22,879 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:22,880 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=efce11bf79d10a7a0e0ca8c92802c505-c6e81182180a4ccf9e324d82c989cfbc 2023-02-08 13:03:22,880 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:22,880 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=efce11bf79d10a7a0e0ca8c92802c505-b63b01ed02f7448f8ba4b6f562ca0246 2023-02-08 13:03:22,880 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |----------f34bf6256167e7e68f1aee5b33d38039/ 2023-02-08 13:03:22,881 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:22,881 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:22,881 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f34bf6256167e7e68f1aee5b33d38039-b53adea9d4c34bde9ec50714001cafa2 2023-02-08 13:03:22,881 DEBUG [Listener at localhost/33639] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:22,881 DEBUG [Listener at localhost/33639] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f34bf6256167e7e68f1aee5b33d38039-dbf71a0252b148c6a53bb5c653743f01 2023-02-08 13:03:22,885 INFO [Listener at localhost/33639] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-08 13:03:23,411 DEBUG [Listener at localhost/33639] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:23,412 INFO [Listener at localhost/33639] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:23,413 DEBUG [Listener at localhost/33639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:23,415 INFO [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:23,416 DEBUG [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690/f1 2023-02-08 13:03:23,417 INFO [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e34a05f1123d6630f6f06db6da6b690 columnFamilyName f1 2023-02-08 13:03:23,417 INFO [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] regionserver.HStore(310): Store=6e34a05f1123d6630f6f06db6da6b690/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,417 INFO [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:23,419 DEBUG [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690/f2 2023-02-08 13:03:23,419 INFO [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e34a05f1123d6630f6f06db6da6b690 columnFamilyName f2 2023-02-08 13:03:23,420 INFO [StoreOpener-6e34a05f1123d6630f6f06db6da6b690-1] regionserver.HStore(310): Store=6e34a05f1123d6630f6f06db6da6b690/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,420 DEBUG [Listener at localhost/33639] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:23,420 INFO [Listener at localhost/33639] regionserver.HRegion(1071): Opened 6e34a05f1123d6630f6f06db6da6b690; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63191938, jitterRate=-0.058366745710372925}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:23,420 DEBUG [Listener at localhost/33639] regionserver.HRegion(964): Region open journal for 6e34a05f1123d6630f6f06db6da6b690: Writing region info on filesystem at 1675861403413Initializing all the Stores at 1675861403414 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403414Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403414Region opened successfully at 1675861403420 (+6 ms) 2023-02-08 13:03:23,420 DEBUG [Listener at localhost/33639] regionserver.HRegion(1603): Closing 6e34a05f1123d6630f6f06db6da6b690, disabling compactions & flushes 2023-02-08 13:03:23,420 INFO [Listener at localhost/33639] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:23,421 DEBUG [Listener at localhost/33639] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:23,421 DEBUG [Listener at localhost/33639] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. after waiting 0 ms 2023-02-08 13:03:23,421 DEBUG [Listener at localhost/33639] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:23,421 INFO [Listener at localhost/33639] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:23,421 DEBUG [Listener at localhost/33639] regionserver.HRegion(1557): Region close journal for 6e34a05f1123d6630f6f06db6da6b690: Waiting for close lock at 1675861403420Disabling compacts and flushes for region at 1675861403420Disabling writes for close at 1675861403421 (+1 ms)Writing region close event to WAL at 1675861403421Closed at 1675861403421 2023-02-08 13:03:23,421 DEBUG [Listener at localhost/33639] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:23,422 INFO [Listener at localhost/33639] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:23,423 DEBUG [Listener at localhost/33639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:23,428 INFO [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:23,429 DEBUG [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1 2023-02-08 13:03:23,429 INFO [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14b62f8b8e0b4b3a0a607fbbaafc0d01 columnFamilyName f1 2023-02-08 13:03:23,434 DEBUG [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1/testWithMockedMapReduceMultiRegion=14b62f8b8e0b4b3a0a607fbbaafc0d01-7b4097d4ec344243ab0ac7ce3c84cf0e 2023-02-08 13:03:23,434 INFO [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] regionserver.HStore(310): Store=14b62f8b8e0b4b3a0a607fbbaafc0d01/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,435 INFO [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:23,435 DEBUG [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2 2023-02-08 13:03:23,436 INFO [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14b62f8b8e0b4b3a0a607fbbaafc0d01 columnFamilyName f2 2023-02-08 13:03:23,439 DEBUG [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2/testWithMockedMapReduceMultiRegion=14b62f8b8e0b4b3a0a607fbbaafc0d01-de7160c650e748c4bc072d50cf757fc7 2023-02-08 13:03:23,440 INFO [StoreOpener-14b62f8b8e0b4b3a0a607fbbaafc0d01-1] regionserver.HStore(310): Store=14b62f8b8e0b4b3a0a607fbbaafc0d01/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,440 DEBUG [Listener at localhost/33639] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:23,440 INFO [Listener at localhost/33639] regionserver.HRegion(1071): Opened 14b62f8b8e0b4b3a0a607fbbaafc0d01; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74987744, jitterRate=0.11740446090698242}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:23,440 DEBUG [Listener at localhost/33639] regionserver.HRegion(964): Region open journal for 14b62f8b8e0b4b3a0a607fbbaafc0d01: Writing region info on filesystem at 1675861403423Initializing all the Stores at 1675861403424 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403424Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403427 (+3 ms)Region opened successfully at 1675861403440 (+13 ms) 2023-02-08 13:03:23,453 DEBUG [Listener at localhost/33639] regionserver.HRegion(1603): Closing 14b62f8b8e0b4b3a0a607fbbaafc0d01, disabling compactions & flushes 2023-02-08 13:03:23,454 INFO [Listener at localhost/33639] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:23,454 DEBUG [Listener at localhost/33639] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:23,454 DEBUG [Listener at localhost/33639] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. after waiting 0 ms 2023-02-08 13:03:23,455 DEBUG [Listener at localhost/33639] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:23,455 INFO [Listener at localhost/33639] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:23,456 DEBUG [Listener at localhost/33639] regionserver.HRegion(1557): Region close journal for 14b62f8b8e0b4b3a0a607fbbaafc0d01: Waiting for close lock at 1675861403453Disabling compacts and flushes for region at 1675861403453Disabling writes for close at 1675861403455 (+2 ms)Writing region close event to WAL at 1675861403455Closed at 1675861403455 2023-02-08 13:03:23,456 DEBUG [Listener at localhost/33639] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:23,456 INFO [Listener at localhost/33639] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:23,458 DEBUG [Listener at localhost/33639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:23,461 INFO [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:23,462 DEBUG [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6/f1 2023-02-08 13:03:23,462 INFO [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1dedfa6ce0377768d24a0625a5bf81f6 columnFamilyName f1 2023-02-08 13:03:23,463 INFO [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] regionserver.HStore(310): Store=1dedfa6ce0377768d24a0625a5bf81f6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,463 INFO [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:23,464 DEBUG [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6/f2 2023-02-08 13:03:23,464 INFO [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1dedfa6ce0377768d24a0625a5bf81f6 columnFamilyName f2 2023-02-08 13:03:23,464 INFO [StoreOpener-1dedfa6ce0377768d24a0625a5bf81f6-1] regionserver.HStore(310): Store=1dedfa6ce0377768d24a0625a5bf81f6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,464 DEBUG [Listener at localhost/33639] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:23,465 INFO [Listener at localhost/33639] regionserver.HRegion(1071): Opened 1dedfa6ce0377768d24a0625a5bf81f6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73474588, jitterRate=0.09485667943954468}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:23,465 DEBUG [Listener at localhost/33639] regionserver.HRegion(964): Region open journal for 1dedfa6ce0377768d24a0625a5bf81f6: Writing region info on filesystem at 1675861403458Initializing all the Stores at 1675861403459 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403459Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403460 (+1 ms)Region opened successfully at 1675861403465 (+5 ms) 2023-02-08 13:03:23,465 DEBUG [Listener at localhost/33639] regionserver.HRegion(1603): Closing 1dedfa6ce0377768d24a0625a5bf81f6, disabling compactions & flushes 2023-02-08 13:03:23,465 INFO [Listener at localhost/33639] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:23,465 DEBUG [Listener at localhost/33639] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:23,465 DEBUG [Listener at localhost/33639] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. after waiting 0 ms 2023-02-08 13:03:23,465 DEBUG [Listener at localhost/33639] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:23,468 INFO [Listener at localhost/33639] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:23,468 DEBUG [Listener at localhost/33639] regionserver.HRegion(1557): Region close journal for 1dedfa6ce0377768d24a0625a5bf81f6: Waiting for close lock at 1675861403465Disabling compacts and flushes for region at 1675861403465Disabling writes for close at 1675861403465Writing region close event to WAL at 1675861403468 (+3 ms)Closed at 1675861403468 2023-02-08 13:03:23,468 DEBUG [Listener at localhost/33639] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:23,469 INFO [Listener at localhost/33639] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:23,471 DEBUG [Listener at localhost/33639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:23,472 INFO [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:23,473 DEBUG [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1 2023-02-08 13:03:23,474 INFO [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fa62d397beda9fc152ed91752b959e2 columnFamilyName f1 2023-02-08 13:03:23,479 DEBUG [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1/testWithMockedMapReduceMultiRegion=5fa62d397beda9fc152ed91752b959e2-2f0090914a254c35832f326d7ea66dcf 2023-02-08 13:03:23,479 INFO [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] regionserver.HStore(310): Store=5fa62d397beda9fc152ed91752b959e2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,479 INFO [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:23,480 DEBUG [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2 2023-02-08 13:03:23,480 INFO [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fa62d397beda9fc152ed91752b959e2 columnFamilyName f2 2023-02-08 13:03:23,487 DEBUG [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2/testWithMockedMapReduceMultiRegion=5fa62d397beda9fc152ed91752b959e2-146487b65e5c44fcaf669d1e8cb26bdf 2023-02-08 13:03:23,487 INFO [StoreOpener-5fa62d397beda9fc152ed91752b959e2-1] regionserver.HStore(310): Store=5fa62d397beda9fc152ed91752b959e2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,487 DEBUG [Listener at localhost/33639] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:23,487 INFO [Listener at localhost/33639] regionserver.HRegion(1071): Opened 5fa62d397beda9fc152ed91752b959e2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68302223, jitterRate=0.017782434821128845}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:23,487 DEBUG [Listener at localhost/33639] regionserver.HRegion(964): Region open journal for 5fa62d397beda9fc152ed91752b959e2: Writing region info on filesystem at 1675861403471Initializing all the Stores at 1675861403471Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403471Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403472 (+1 ms)Region opened successfully at 1675861403487 (+15 ms) 2023-02-08 13:03:23,495 DEBUG [Listener at localhost/33639] regionserver.HRegion(1603): Closing 5fa62d397beda9fc152ed91752b959e2, disabling compactions & flushes 2023-02-08 13:03:23,496 INFO [Listener at localhost/33639] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:23,496 DEBUG [Listener at localhost/33639] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:23,496 DEBUG [Listener at localhost/33639] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. after waiting 0 ms 2023-02-08 13:03:23,496 DEBUG [Listener at localhost/33639] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:23,497 INFO [Listener at localhost/33639] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:23,497 DEBUG [Listener at localhost/33639] regionserver.HRegion(1557): Region close journal for 5fa62d397beda9fc152ed91752b959e2: Waiting for close lock at 1675861403495Disabling compacts and flushes for region at 1675861403495Disabling writes for close at 1675861403496 (+1 ms)Writing region close event to WAL at 1675861403497 (+1 ms)Closed at 1675861403497 2023-02-08 13:03:23,497 DEBUG [Listener at localhost/33639] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:23,497 INFO [Listener at localhost/33639] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:23,499 DEBUG [Listener at localhost/33639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:23,501 INFO [StoreOpener-a483102b691671503ad7e7727d21c140-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a483102b691671503ad7e7727d21c140 2023-02-08 13:03:23,501 DEBUG [StoreOpener-a483102b691671503ad7e7727d21c140-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1 2023-02-08 13:03:23,502 INFO [StoreOpener-a483102b691671503ad7e7727d21c140-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a483102b691671503ad7e7727d21c140 columnFamilyName f1 2023-02-08 13:03:23,509 DEBUG [StoreOpener-a483102b691671503ad7e7727d21c140-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1/testWithMockedMapReduceMultiRegion=a483102b691671503ad7e7727d21c140-880d1fd26f5941d8afe2b08bc9173f4c 2023-02-08 13:03:23,509 INFO [StoreOpener-a483102b691671503ad7e7727d21c140-1] regionserver.HStore(310): Store=a483102b691671503ad7e7727d21c140/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,509 INFO [StoreOpener-a483102b691671503ad7e7727d21c140-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a483102b691671503ad7e7727d21c140 2023-02-08 13:03:23,510 DEBUG [StoreOpener-a483102b691671503ad7e7727d21c140-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2 2023-02-08 13:03:23,511 INFO [StoreOpener-a483102b691671503ad7e7727d21c140-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a483102b691671503ad7e7727d21c140 columnFamilyName f2 2023-02-08 13:03:23,524 DEBUG [StoreOpener-a483102b691671503ad7e7727d21c140-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2/testWithMockedMapReduceMultiRegion=a483102b691671503ad7e7727d21c140-3ee8346a8a63453fa89634710fa0d539 2023-02-08 13:03:23,524 INFO [StoreOpener-a483102b691671503ad7e7727d21c140-1] regionserver.HStore(310): Store=a483102b691671503ad7e7727d21c140/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,525 DEBUG [Listener at localhost/33639] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:23,525 INFO [Listener at localhost/33639] regionserver.HRegion(1071): Opened a483102b691671503ad7e7727d21c140; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73574456, jitterRate=0.09634482860565186}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:23,525 DEBUG [Listener at localhost/33639] regionserver.HRegion(964): Region open journal for a483102b691671503ad7e7727d21c140: Writing region info on filesystem at 1675861403499Initializing all the Stores at 1675861403500 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403500Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403500Region opened successfully at 1675861403525 (+25 ms) 2023-02-08 13:03:23,533 DEBUG [Listener at localhost/33639] regionserver.HRegion(1603): Closing a483102b691671503ad7e7727d21c140, disabling compactions & flushes 2023-02-08 13:03:23,533 INFO [Listener at localhost/33639] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:23,533 DEBUG [Listener at localhost/33639] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:23,533 DEBUG [Listener at localhost/33639] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. after waiting 0 ms 2023-02-08 13:03:23,533 DEBUG [Listener at localhost/33639] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:23,534 INFO [Listener at localhost/33639] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:23,534 DEBUG [Listener at localhost/33639] regionserver.HRegion(1557): Region close journal for a483102b691671503ad7e7727d21c140: Waiting for close lock at 1675861403533Disabling compacts and flushes for region at 1675861403533Disabling writes for close at 1675861403533Writing region close event to WAL at 1675861403534 (+1 ms)Closed at 1675861403534 2023-02-08 13:03:23,535 DEBUG [Listener at localhost/33639] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:23,535 INFO [Listener at localhost/33639] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:23,540 DEBUG [Listener at localhost/33639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:23,542 INFO [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:23,543 DEBUG [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1 2023-02-08 13:03:23,544 INFO [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efce11bf79d10a7a0e0ca8c92802c505 columnFamilyName f1 2023-02-08 13:03:23,548 DEBUG [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1/testWithMockedMapReduceMultiRegion=efce11bf79d10a7a0e0ca8c92802c505-c6e81182180a4ccf9e324d82c989cfbc 2023-02-08 13:03:23,548 INFO [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] regionserver.HStore(310): Store=efce11bf79d10a7a0e0ca8c92802c505/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,548 INFO [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:23,549 DEBUG [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2 2023-02-08 13:03:23,549 INFO [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efce11bf79d10a7a0e0ca8c92802c505 columnFamilyName f2 2023-02-08 13:03:23,553 DEBUG [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2/testWithMockedMapReduceMultiRegion=efce11bf79d10a7a0e0ca8c92802c505-b63b01ed02f7448f8ba4b6f562ca0246 2023-02-08 13:03:23,553 INFO [StoreOpener-efce11bf79d10a7a0e0ca8c92802c505-1] regionserver.HStore(310): Store=efce11bf79d10a7a0e0ca8c92802c505/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,553 DEBUG [Listener at localhost/33639] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:23,553 INFO [Listener at localhost/33639] regionserver.HRegion(1071): Opened efce11bf79d10a7a0e0ca8c92802c505; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72708472, jitterRate=0.08344066143035889}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:23,553 DEBUG [Listener at localhost/33639] regionserver.HRegion(964): Region open journal for efce11bf79d10a7a0e0ca8c92802c505: Writing region info on filesystem at 1675861403540Initializing all the Stores at 1675861403541 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403541Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403541Region opened successfully at 1675861403553 (+12 ms) 2023-02-08 13:03:23,562 DEBUG [Listener at localhost/33639] regionserver.HRegion(1603): Closing efce11bf79d10a7a0e0ca8c92802c505, disabling compactions & flushes 2023-02-08 13:03:23,562 INFO [Listener at localhost/33639] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:23,562 DEBUG [Listener at localhost/33639] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:23,562 DEBUG [Listener at localhost/33639] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. after waiting 0 ms 2023-02-08 13:03:23,562 DEBUG [Listener at localhost/33639] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:23,564 INFO [Listener at localhost/33639] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:23,564 DEBUG [Listener at localhost/33639] regionserver.HRegion(1557): Region close journal for efce11bf79d10a7a0e0ca8c92802c505: Waiting for close lock at 1675861403562Disabling compacts and flushes for region at 1675861403562Disabling writes for close at 1675861403562Writing region close event to WAL at 1675861403564 (+2 ms)Closed at 1675861403564 2023-02-08 13:03:23,564 DEBUG [Listener at localhost/33639] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:23,565 INFO [Listener at localhost/33639] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:23,569 DEBUG [Listener at localhost/33639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:23,571 INFO [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:23,572 DEBUG [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1 2023-02-08 13:03:23,572 INFO [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4e8cbd16c49c254c64e02f036e9aa71 columnFamilyName f1 2023-02-08 13:03:23,581 DEBUG [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1/testWithMockedMapReduceMultiRegion=b4e8cbd16c49c254c64e02f036e9aa71-e5e7ea1ce3b947f68e95864ede66541d 2023-02-08 13:03:23,581 INFO [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] regionserver.HStore(310): Store=b4e8cbd16c49c254c64e02f036e9aa71/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,581 INFO [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:23,582 DEBUG [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2 2023-02-08 13:03:23,582 INFO [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4e8cbd16c49c254c64e02f036e9aa71 columnFamilyName f2 2023-02-08 13:03:23,586 DEBUG [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2/testWithMockedMapReduceMultiRegion=b4e8cbd16c49c254c64e02f036e9aa71-3616e1cd449c4b42a8d80457c3c3234f 2023-02-08 13:03:23,586 INFO [StoreOpener-b4e8cbd16c49c254c64e02f036e9aa71-1] regionserver.HStore(310): Store=b4e8cbd16c49c254c64e02f036e9aa71/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,586 DEBUG [Listener at localhost/33639] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:23,587 INFO [Listener at localhost/33639] regionserver.HRegion(1071): Opened b4e8cbd16c49c254c64e02f036e9aa71; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61390496, jitterRate=-0.08521032333374023}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:23,587 DEBUG [Listener at localhost/33639] regionserver.HRegion(964): Region open journal for b4e8cbd16c49c254c64e02f036e9aa71: Writing region info on filesystem at 1675861403569Initializing all the Stores at 1675861403570 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403570Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403570Region opened successfully at 1675861403587 (+17 ms) 2023-02-08 13:03:23,634 DEBUG [Listener at localhost/33639] regionserver.HRegion(1603): Closing b4e8cbd16c49c254c64e02f036e9aa71, disabling compactions & flushes 2023-02-08 13:03:23,634 INFO [Listener at localhost/33639] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:23,634 DEBUG [Listener at localhost/33639] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:23,634 DEBUG [Listener at localhost/33639] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. after waiting 0 ms 2023-02-08 13:03:23,634 DEBUG [Listener at localhost/33639] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:23,635 INFO [Listener at localhost/33639] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:23,635 DEBUG [Listener at localhost/33639] regionserver.HRegion(1557): Region close journal for b4e8cbd16c49c254c64e02f036e9aa71: Waiting for close lock at 1675861403634Disabling compacts and flushes for region at 1675861403634Disabling writes for close at 1675861403634Writing region close event to WAL at 1675861403635 (+1 ms)Closed at 1675861403635 2023-02-08 13:03:23,635 DEBUG [Listener at localhost/33639] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:23,635 INFO [Listener at localhost/33639] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:23,637 DEBUG [Listener at localhost/33639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:23,639 INFO [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:23,640 DEBUG [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1 2023-02-08 13:03:23,640 INFO [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f34bf6256167e7e68f1aee5b33d38039 columnFamilyName f1 2023-02-08 13:03:23,644 DEBUG [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1/testWithMockedMapReduceMultiRegion=f34bf6256167e7e68f1aee5b33d38039-b53adea9d4c34bde9ec50714001cafa2 2023-02-08 13:03:23,645 INFO [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] regionserver.HStore(310): Store=f34bf6256167e7e68f1aee5b33d38039/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,645 INFO [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:23,645 DEBUG [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2 2023-02-08 13:03:23,646 INFO [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f34bf6256167e7e68f1aee5b33d38039 columnFamilyName f2 2023-02-08 13:03:23,649 DEBUG [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2/testWithMockedMapReduceMultiRegion=f34bf6256167e7e68f1aee5b33d38039-dbf71a0252b148c6a53bb5c653743f01 2023-02-08 13:03:23,649 INFO [StoreOpener-f34bf6256167e7e68f1aee5b33d38039-1] regionserver.HStore(310): Store=f34bf6256167e7e68f1aee5b33d38039/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,649 DEBUG [Listener at localhost/33639] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:23,650 INFO [Listener at localhost/33639] regionserver.HRegion(1071): Opened f34bf6256167e7e68f1aee5b33d38039; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68959346, jitterRate=0.0275743305683136}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:23,650 DEBUG [Listener at localhost/33639] regionserver.HRegion(964): Region open journal for f34bf6256167e7e68f1aee5b33d38039: Writing region info on filesystem at 1675861403637Initializing all the Stores at 1675861403638 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403638Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403638Region opened successfully at 1675861403650 (+12 ms) 2023-02-08 13:03:23,662 DEBUG [Listener at localhost/33639] regionserver.HRegion(1603): Closing f34bf6256167e7e68f1aee5b33d38039, disabling compactions & flushes 2023-02-08 13:03:23,663 INFO [Listener at localhost/33639] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:23,663 DEBUG [Listener at localhost/33639] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:23,663 DEBUG [Listener at localhost/33639] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. after waiting 0 ms 2023-02-08 13:03:23,663 DEBUG [Listener at localhost/33639] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:23,664 INFO [Listener at localhost/33639] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:23,664 DEBUG [Listener at localhost/33639] regionserver.HRegion(1557): Region close journal for f34bf6256167e7e68f1aee5b33d38039: Waiting for close lock at 1675861403662Disabling compacts and flushes for region at 1675861403662Disabling writes for close at 1675861403663 (+1 ms)Writing region close event to WAL at 1675861403664 (+1 ms)Closed at 1675861403664 2023-02-08 13:03:23,664 DEBUG [Listener at localhost/33639] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:23,664 INFO [Listener at localhost/33639] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:23,665 DEBUG [Listener at localhost/33639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:23,667 INFO [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:23,668 DEBUG [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1 2023-02-08 13:03:23,668 INFO [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0affe31618e6bfe674fdedfa4e15968 columnFamilyName f1 2023-02-08 13:03:23,672 DEBUG [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1/testWithMockedMapReduceMultiRegion=b0affe31618e6bfe674fdedfa4e15968-d2574f74eab94061bec46d7f85d13744 2023-02-08 13:03:23,672 INFO [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] regionserver.HStore(310): Store=b0affe31618e6bfe674fdedfa4e15968/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,672 INFO [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:23,673 DEBUG [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2 2023-02-08 13:03:23,673 INFO [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0affe31618e6bfe674fdedfa4e15968 columnFamilyName f2 2023-02-08 13:03:23,676 DEBUG [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2/testWithMockedMapReduceMultiRegion=b0affe31618e6bfe674fdedfa4e15968-55e0257f726640e6ac1ef9c92fe868ec 2023-02-08 13:03:23,677 INFO [StoreOpener-b0affe31618e6bfe674fdedfa4e15968-1] regionserver.HStore(310): Store=b0affe31618e6bfe674fdedfa4e15968/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,677 DEBUG [Listener at localhost/33639] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:23,677 INFO [Listener at localhost/33639] regionserver.HRegion(1071): Opened b0affe31618e6bfe674fdedfa4e15968; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73494469, jitterRate=0.09515292942523956}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:23,677 DEBUG [Listener at localhost/33639] regionserver.HRegion(964): Region open journal for b0affe31618e6bfe674fdedfa4e15968: Writing region info on filesystem at 1675861403666Initializing all the Stores at 1675861403666Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403666Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403666Region opened successfully at 1675861403677 (+11 ms) 2023-02-08 13:03:23,686 DEBUG [Listener at localhost/33639] regionserver.HRegion(1603): Closing b0affe31618e6bfe674fdedfa4e15968, disabling compactions & flushes 2023-02-08 13:03:23,686 INFO [Listener at localhost/33639] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:23,686 DEBUG [Listener at localhost/33639] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:23,687 DEBUG [Listener at localhost/33639] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. after waiting 0 ms 2023-02-08 13:03:23,687 DEBUG [Listener at localhost/33639] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:23,687 INFO [Listener at localhost/33639] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:23,687 DEBUG [Listener at localhost/33639] regionserver.HRegion(1557): Region close journal for b0affe31618e6bfe674fdedfa4e15968: Waiting for close lock at 1675861403686Disabling compacts and flushes for region at 1675861403686Disabling writes for close at 1675861403687 (+1 ms)Writing region close event to WAL at 1675861403687Closed at 1675861403687 2023-02-08 13:03:23,688 DEBUG [Listener at localhost/33639] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:23,688 INFO [Listener at localhost/33639] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:23,689 DEBUG [Listener at localhost/33639] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:23,691 INFO [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:23,692 DEBUG [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1 2023-02-08 13:03:23,692 INFO [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af105189d7e976ff1119f2d054c2d629 columnFamilyName f1 2023-02-08 13:03:23,695 DEBUG [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1/testWithMockedMapReduceMultiRegion=af105189d7e976ff1119f2d054c2d629-0de744fd111e49ce96c91eeec1489344 2023-02-08 13:03:23,695 INFO [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] regionserver.HStore(310): Store=af105189d7e976ff1119f2d054c2d629/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,696 INFO [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:23,696 DEBUG [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2 2023-02-08 13:03:23,696 INFO [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af105189d7e976ff1119f2d054c2d629 columnFamilyName f2 2023-02-08 13:03:23,700 DEBUG [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] regionserver.HStore(539): loaded hdfs://localhost:36581/user/jenkins/test-data/558c3d46-3726-a6a7-398b-870fa0620979/testWithMockedMapReduceMultiRegion/96c4d3be-26dd-4e42-aa09-4b01eef15ec8/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2/testWithMockedMapReduceMultiRegion=af105189d7e976ff1119f2d054c2d629-0b13c3b705a44294b0072f1f498d5180 2023-02-08 13:03:23,700 INFO [StoreOpener-af105189d7e976ff1119f2d054c2d629-1] regionserver.HStore(310): Store=af105189d7e976ff1119f2d054c2d629/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:23,700 DEBUG [Listener at localhost/33639] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:23,700 INFO [Listener at localhost/33639] regionserver.HRegion(1071): Opened af105189d7e976ff1119f2d054c2d629; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75000074, jitterRate=0.11758819222450256}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:23,700 DEBUG [Listener at localhost/33639] regionserver.HRegion(964): Region open journal for af105189d7e976ff1119f2d054c2d629: Writing region info on filesystem at 1675861403689Initializing all the Stores at 1675861403690 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403690Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861403690Region opened successfully at 1675861403700 (+10 ms) 2023-02-08 13:03:23,708 DEBUG [Listener at localhost/33639] regionserver.HRegion(1603): Closing af105189d7e976ff1119f2d054c2d629, disabling compactions & flushes 2023-02-08 13:03:23,708 INFO [Listener at localhost/33639] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:23,708 DEBUG [Listener at localhost/33639] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:23,708 DEBUG [Listener at localhost/33639] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. after waiting 0 ms 2023-02-08 13:03:23,708 DEBUG [Listener at localhost/33639] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:23,709 INFO [Listener at localhost/33639] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:23,709 DEBUG [Listener at localhost/33639] regionserver.HRegion(1557): Region close journal for af105189d7e976ff1119f2d054c2d629: Waiting for close lock at 1675861403708Disabling compacts and flushes for region at 1675861403708Disabling writes for close at 1675861403708Writing region close event to WAL at 1675861403709 (+1 ms)Closed at 1675861403709 2023-02-08 13:03:23,712 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:23,712 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:23,713 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-08 13:03:23,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-08 13:03:23,716 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:23,716 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:23,716 INFO [Listener at localhost/33639] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-08 13:03:23,717 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-08 13:03:23,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:23,719 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:23,719 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:23,720 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861403720"}]},"ts":"1675861403720"} 2023-02-08 13:03:23,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 13:03:23,721 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-08 13:03:23,723 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-08 13:03:23,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e34a05f1123d6630f6f06db6da6b690, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4e8cbd16c49c254c64e02f036e9aa71, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a483102b691671503ad7e7727d21c140, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14b62f8b8e0b4b3a0a607fbbaafc0d01, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=af105189d7e976ff1119f2d054c2d629, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f34bf6256167e7e68f1aee5b33d38039, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fa62d397beda9fc152ed91752b959e2, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=efce11bf79d10a7a0e0ca8c92802c505, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0affe31618e6bfe674fdedfa4e15968, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1dedfa6ce0377768d24a0625a5bf81f6, UNASSIGN}] 2023-02-08 13:03:23,725 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a483102b691671503ad7e7727d21c140, UNASSIGN 2023-02-08 13:03:23,725 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14b62f8b8e0b4b3a0a607fbbaafc0d01, UNASSIGN 2023-02-08 13:03:23,725 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e34a05f1123d6630f6f06db6da6b690, UNASSIGN 2023-02-08 13:03:23,725 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4e8cbd16c49c254c64e02f036e9aa71, UNASSIGN 2023-02-08 13:03:23,725 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1dedfa6ce0377768d24a0625a5bf81f6, UNASSIGN 2023-02-08 13:03:23,725 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a483102b691671503ad7e7727d21c140, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:23,726 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=14b62f8b8e0b4b3a0a607fbbaafc0d01, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:23,726 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675861399938.a483102b691671503ad7e7727d21c140.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403725"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861403725"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861403725"}]},"ts":"1675861403725"} 2023-02-08 13:03:23,726 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=6e34a05f1123d6630f6f06db6da6b690, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:23,726 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403726"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861403726"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861403726"}]},"ts":"1675861403726"} 2023-02-08 13:03:23,726 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675861403726"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861403726"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861403726"}]},"ts":"1675861403726"} 2023-02-08 13:03:23,726 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=b4e8cbd16c49c254c64e02f036e9aa71, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:23,726 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=1dedfa6ce0377768d24a0625a5bf81f6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:23,726 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403726"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861403726"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861403726"}]},"ts":"1675861403726"} 2023-02-08 13:03:23,726 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675861403726"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861403726"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861403726"}]},"ts":"1675861403726"} 2023-02-08 13:03:23,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure a483102b691671503ad7e7727d21c140, server=jenkins-hbase4.apache.org,40069,1675861398701}] 2023-02-08 13:03:23,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=37, state=RUNNABLE; CloseRegionProcedure 14b62f8b8e0b4b3a0a607fbbaafc0d01, server=jenkins-hbase4.apache.org,40069,1675861398701}] 2023-02-08 13:03:23,729 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=34, state=RUNNABLE; CloseRegionProcedure 6e34a05f1123d6630f6f06db6da6b690, server=jenkins-hbase4.apache.org,43751,1675861398672}] 2023-02-08 13:03:23,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=35, state=RUNNABLE; CloseRegionProcedure b4e8cbd16c49c254c64e02f036e9aa71, server=jenkins-hbase4.apache.org,43751,1675861398672}] 2023-02-08 13:03:23,729 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0affe31618e6bfe674fdedfa4e15968, UNASSIGN 2023-02-08 13:03:23,730 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=b0affe31618e6bfe674fdedfa4e15968, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:23,730 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403730"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861403730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861403730"}]},"ts":"1675861403730"} 2023-02-08 13:03:23,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 1dedfa6ce0377768d24a0625a5bf81f6, server=jenkins-hbase4.apache.org,43751,1675861398672}] 2023-02-08 13:03:23,730 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=efce11bf79d10a7a0e0ca8c92802c505, UNASSIGN 2023-02-08 13:03:23,731 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fa62d397beda9fc152ed91752b959e2, UNASSIGN 2023-02-08 13:03:23,731 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=efce11bf79d10a7a0e0ca8c92802c505, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:23,732 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403731"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861403731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861403731"}]},"ts":"1675861403731"} 2023-02-08 13:03:23,732 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f34bf6256167e7e68f1aee5b33d38039, UNASSIGN 2023-02-08 13:03:23,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure b0affe31618e6bfe674fdedfa4e15968, server=jenkins-hbase4.apache.org,40069,1675861398701}] 2023-02-08 13:03:23,732 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5fa62d397beda9fc152ed91752b959e2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:23,732 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403732"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861403732"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861403732"}]},"ts":"1675861403732"} 2023-02-08 13:03:23,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure efce11bf79d10a7a0e0ca8c92802c505, server=jenkins-hbase4.apache.org,43751,1675861398672}] 2023-02-08 13:03:23,733 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=f34bf6256167e7e68f1aee5b33d38039, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:23,733 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861403733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861403733"}]},"ts":"1675861403733"} 2023-02-08 13:03:23,733 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=af105189d7e976ff1119f2d054c2d629, UNASSIGN 2023-02-08 13:03:23,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 5fa62d397beda9fc152ed91752b959e2, server=jenkins-hbase4.apache.org,40069,1675861398701}] 2023-02-08 13:03:23,734 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=af105189d7e976ff1119f2d054c2d629, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:23,734 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403734"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861403734"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861403734"}]},"ts":"1675861403734"} 2023-02-08 13:03:23,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure f34bf6256167e7e68f1aee5b33d38039, server=jenkins-hbase4.apache.org,40069,1675861398701}] 2023-02-08 13:03:23,739 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure af105189d7e976ff1119f2d054c2d629, server=jenkins-hbase4.apache.org,43751,1675861398672}] 2023-02-08 13:03:23,821 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:23,821 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:23,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 13:03:23,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:23,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f34bf6256167e7e68f1aee5b33d38039, disabling compactions & flushes 2023-02-08 13:03:23,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:23,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:23,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. after waiting 0 ms 2023-02-08 13:03:23,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:23,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:23,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing af105189d7e976ff1119f2d054c2d629, disabling compactions & flushes 2023-02-08 13:03:23,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:23,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:23,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. after waiting 0 ms 2023-02-08 13:03:23,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:23,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:23,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039. 2023-02-08 13:03:23,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f34bf6256167e7e68f1aee5b33d38039: Waiting for close lock at 1675861403879Running coprocessor pre-close hooks at 1675861403879Disabling compacts and flushes for region at 1675861403879Disabling writes for close at 1675861403879Writing region close event to WAL at 1675861403880 (+1 ms)Running coprocessor post-close hooks at 1675861403885 (+5 ms)Closed at 1675861403886 (+1 ms) 2023-02-08 13:03:23,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:23,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:23,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:23,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 14b62f8b8e0b4b3a0a607fbbaafc0d01, disabling compactions & flushes 2023-02-08 13:03:23,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:23,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:23,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. after waiting 0 ms 2023-02-08 13:03:23,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:23,888 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=f34bf6256167e7e68f1aee5b33d38039, regionState=CLOSED 2023-02-08 13:03:23,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629. 2023-02-08 13:03:23,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for af105189d7e976ff1119f2d054c2d629: Waiting for close lock at 1675861403881Running coprocessor pre-close hooks at 1675861403881Disabling compacts and flushes for region at 1675861403881Disabling writes for close at 1675861403881Writing region close event to WAL at 1675861403884 (+3 ms)Running coprocessor post-close hooks at 1675861403888 (+4 ms)Closed at 1675861403889 (+1 ms) 2023-02-08 13:03:23,889 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403888"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861403888"}]},"ts":"1675861403888"} 2023-02-08 13:03:23,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:23,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:23,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b4e8cbd16c49c254c64e02f036e9aa71, disabling compactions & flushes 2023-02-08 13:03:23,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:23,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:23,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. after waiting 0 ms 2023-02-08 13:03:23,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:23,891 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=af105189d7e976ff1119f2d054c2d629, regionState=CLOSED 2023-02-08 13:03:23,891 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403891"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861403891"}]},"ts":"1675861403891"} 2023-02-08 13:03:23,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-08 13:03:23,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure f34bf6256167e7e68f1aee5b33d38039, server=jenkins-hbase4.apache.org,40069,1675861398701 in 155 msec 2023-02-08 13:03:23,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f34bf6256167e7e68f1aee5b33d38039, UNASSIGN in 169 msec 2023-02-08 13:03:23,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:23,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:23,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01. 2023-02-08 13:03:23,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-08 13:03:23,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 14b62f8b8e0b4b3a0a607fbbaafc0d01: Waiting for close lock at 1675861403888Running coprocessor pre-close hooks at 1675861403888Disabling compacts and flushes for region at 1675861403888Disabling writes for close at 1675861403888Writing region close event to WAL at 1675861403891 (+3 ms)Running coprocessor post-close hooks at 1675861403895 (+4 ms)Closed at 1675861403896 (+1 ms) 2023-02-08 13:03:23,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure af105189d7e976ff1119f2d054c2d629, server=jenkins-hbase4.apache.org,43751,1675861398672 in 153 msec 2023-02-08 13:03:23,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71. 2023-02-08 13:03:23,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b4e8cbd16c49c254c64e02f036e9aa71: Waiting for close lock at 1675861403890Running coprocessor pre-close hooks at 1675861403890Disabling compacts and flushes for region at 1675861403890Disabling writes for close at 1675861403890Writing region close event to WAL at 1675861403892 (+2 ms)Running coprocessor post-close hooks at 1675861403897 (+5 ms)Closed at 1675861403897 2023-02-08 13:03:23,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=af105189d7e976ff1119f2d054c2d629, UNASSIGN in 173 msec 2023-02-08 13:03:23,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:23,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a483102b691671503ad7e7727d21c140 2023-02-08 13:03:23,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a483102b691671503ad7e7727d21c140, disabling compactions & flushes 2023-02-08 13:03:23,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:23,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:23,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. after waiting 0 ms 2023-02-08 13:03:23,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:23,899 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=14b62f8b8e0b4b3a0a607fbbaafc0d01, regionState=CLOSED 2023-02-08 13:03:23,899 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403899"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861403899"}]},"ts":"1675861403899"} 2023-02-08 13:03:23,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:23,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:23,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1dedfa6ce0377768d24a0625a5bf81f6, disabling compactions & flushes 2023-02-08 13:03:23,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:23,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:23,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. after waiting 0 ms 2023-02-08 13:03:23,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:23,899 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=b4e8cbd16c49c254c64e02f036e9aa71, regionState=CLOSED 2023-02-08 13:03:23,899 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403899"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861403899"}]},"ts":"1675861403899"} 2023-02-08 13:03:23,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=37 2023-02-08 13:03:23,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=37, state=SUCCESS; CloseRegionProcedure 14b62f8b8e0b4b3a0a607fbbaafc0d01, server=jenkins-hbase4.apache.org,40069,1675861398701 in 172 msec 2023-02-08 13:03:23,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=35 2023-02-08 13:03:23,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=14b62f8b8e0b4b3a0a607fbbaafc0d01, UNASSIGN in 178 msec 2023-02-08 13:03:23,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=35, state=SUCCESS; CloseRegionProcedure b4e8cbd16c49c254c64e02f036e9aa71, server=jenkins-hbase4.apache.org,43751,1675861398672 in 172 msec 2023-02-08 13:03:23,903 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b4e8cbd16c49c254c64e02f036e9aa71, UNASSIGN in 180 msec 2023-02-08 13:03:23,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:23,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140. 2023-02-08 13:03:23,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a483102b691671503ad7e7727d21c140: Waiting for close lock at 1675861403898Running coprocessor pre-close hooks at 1675861403898Disabling compacts and flushes for region at 1675861403898Disabling writes for close at 1675861403898Writing region close event to WAL at 1675861403900 (+2 ms)Running coprocessor post-close hooks at 1675861403905 (+5 ms)Closed at 1675861403905 2023-02-08 13:03:23,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 13:03:23,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6. 2023-02-08 13:03:23,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1dedfa6ce0377768d24a0625a5bf81f6: Waiting for close lock at 1675861403899Running coprocessor pre-close hooks at 1675861403899Disabling compacts and flushes for region at 1675861403899Disabling writes for close at 1675861403899Writing region close event to WAL at 1675861403900 (+1 ms)Running coprocessor post-close hooks at 1675861403906 (+6 ms)Closed at 1675861403907 (+1 ms) 2023-02-08 13:03:23,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a483102b691671503ad7e7727d21c140 2023-02-08 13:03:23,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:23,908 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a483102b691671503ad7e7727d21c140, regionState=CLOSED 2023-02-08 13:03:23,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5fa62d397beda9fc152ed91752b959e2, disabling compactions & flushes 2023-02-08 13:03:23,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:23,908 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675861399938.a483102b691671503ad7e7727d21c140.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403908"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861403908"}]},"ts":"1675861403908"} 2023-02-08 13:03:23,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:23,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. after waiting 0 ms 2023-02-08 13:03:23,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:23,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:23,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:23,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing efce11bf79d10a7a0e0ca8c92802c505, disabling compactions & flushes 2023-02-08 13:03:23,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:23,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:23,908 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=1dedfa6ce0377768d24a0625a5bf81f6, regionState=CLOSED 2023-02-08 13:03:23,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. after waiting 0 ms 2023-02-08 13:03:23,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:23,909 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675861403908"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861403908"}]},"ts":"1675861403908"} 2023-02-08 13:03:23,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-08 13:03:23,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure a483102b691671503ad7e7727d21c140, server=jenkins-hbase4.apache.org,40069,1675861398701 in 182 msec 2023-02-08 13:03:23,911 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-08 13:03:23,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a483102b691671503ad7e7727d21c140, UNASSIGN in 188 msec 2023-02-08 13:03:23,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 1dedfa6ce0377768d24a0625a5bf81f6, server=jenkins-hbase4.apache.org,43751,1675861398672 in 180 msec 2023-02-08 13:03:23,912 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1dedfa6ce0377768d24a0625a5bf81f6, UNASSIGN in 189 msec 2023-02-08 13:03:23,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:23,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:23,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2. 2023-02-08 13:03:23,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5fa62d397beda9fc152ed91752b959e2: Waiting for close lock at 1675861403908Running coprocessor pre-close hooks at 1675861403908Disabling compacts and flushes for region at 1675861403908Disabling writes for close at 1675861403908Writing region close event to WAL at 1675861403914 (+6 ms)Running coprocessor post-close hooks at 1675861403917 (+3 ms)Closed at 1675861403918 (+1 ms) 2023-02-08 13:03:23,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505. 2023-02-08 13:03:23,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for efce11bf79d10a7a0e0ca8c92802c505: Waiting for close lock at 1675861403908Running coprocessor pre-close hooks at 1675861403908Disabling compacts and flushes for region at 1675861403908Disabling writes for close at 1675861403909 (+1 ms)Writing region close event to WAL at 1675861403915 (+6 ms)Running coprocessor post-close hooks at 1675861403918 (+3 ms)Closed at 1675861403919 (+1 ms) 2023-02-08 13:03:23,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:23,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:23,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b0affe31618e6bfe674fdedfa4e15968, disabling compactions & flushes 2023-02-08 13:03:23,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:23,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:23,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. after waiting 0 ms 2023-02-08 13:03:23,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:23,920 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5fa62d397beda9fc152ed91752b959e2, regionState=CLOSED 2023-02-08 13:03:23,920 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403920"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861403920"}]},"ts":"1675861403920"} 2023-02-08 13:03:23,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:23,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:23,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6e34a05f1123d6630f6f06db6da6b690, disabling compactions & flushes 2023-02-08 13:03:23,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:23,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:23,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. after waiting 0 ms 2023-02-08 13:03:23,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:23,921 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=efce11bf79d10a7a0e0ca8c92802c505, regionState=CLOSED 2023-02-08 13:03:23,921 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403921"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861403921"}]},"ts":"1675861403921"} 2023-02-08 13:03:23,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-08 13:03:23,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 5fa62d397beda9fc152ed91752b959e2, server=jenkins-hbase4.apache.org,40069,1675861398701 in 188 msec 2023-02-08 13:03:23,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-08 13:03:23,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure efce11bf79d10a7a0e0ca8c92802c505, server=jenkins-hbase4.apache.org,43751,1675861398672 in 189 msec 2023-02-08 13:03:23,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 13:03:23,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:23,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5fa62d397beda9fc152ed91752b959e2, UNASSIGN in 200 msec 2023-02-08 13:03:23,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690. 2023-02-08 13:03:23,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6e34a05f1123d6630f6f06db6da6b690: Waiting for close lock at 1675861403921Running coprocessor pre-close hooks at 1675861403921Disabling compacts and flushes for region at 1675861403921Disabling writes for close at 1675861403921Writing region close event to WAL at 1675861403921Running coprocessor post-close hooks at 1675861403925 (+4 ms)Closed at 1675861403926 (+1 ms) 2023-02-08 13:03:23,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968. 2023-02-08 13:03:23,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b0affe31618e6bfe674fdedfa4e15968: Waiting for close lock at 1675861403920Running coprocessor pre-close hooks at 1675861403920Disabling compacts and flushes for region at 1675861403920Disabling writes for close at 1675861403920Writing region close event to WAL at 1675861403922 (+2 ms)Running coprocessor post-close hooks at 1675861403926 (+4 ms)Closed at 1675861403926 2023-02-08 13:03:23,927 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=efce11bf79d10a7a0e0ca8c92802c505, UNASSIGN in 201 msec 2023-02-08 13:03:23,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:23,928 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=b0affe31618e6bfe674fdedfa4e15968, regionState=CLOSED 2023-02-08 13:03:23,928 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675861403928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861403928"}]},"ts":"1675861403928"} 2023-02-08 13:03:23,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:23,928 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=6e34a05f1123d6630f6f06db6da6b690, regionState=CLOSED 2023-02-08 13:03:23,928 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675861403928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861403928"}]},"ts":"1675861403928"} 2023-02-08 13:03:23,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-08 13:03:23,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure b0affe31618e6bfe674fdedfa4e15968, server=jenkins-hbase4.apache.org,40069,1675861398701 in 197 msec 2023-02-08 13:03:23,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=34 2023-02-08 13:03:23,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=34, state=SUCCESS; CloseRegionProcedure 6e34a05f1123d6630f6f06db6da6b690, server=jenkins-hbase4.apache.org,43751,1675861398672 in 200 msec 2023-02-08 13:03:23,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b0affe31618e6bfe674fdedfa4e15968, UNASSIGN in 207 msec 2023-02-08 13:03:23,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=34, resume processing ppid=33 2023-02-08 13:03:23,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e34a05f1123d6630f6f06db6da6b690, UNASSIGN in 208 msec 2023-02-08 13:03:23,932 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861403932"}]},"ts":"1675861403932"} 2023-02-08 13:03:23,933 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-08 13:03:23,934 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-08 13:03:23,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 218 msec 2023-02-08 13:03:24,022 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:24,023 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:24,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-08 13:03:24,024 INFO [Listener at localhost/33639] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-08 13:03:24,024 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:24,024 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:24,025 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-08 13:03:24,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:24,027 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:24,028 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:24,028 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:24,028 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:24,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-08 13:03:24,038 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:24,038 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:24,038 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:24,038 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:24,038 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:24,038 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:24,038 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:24,038 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140 2023-02-08 13:03:24,042 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/recovered.edits] 2023-02-08 13:03:24,042 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690/f1, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690/f2, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690/recovered.edits] 2023-02-08 13:03:24,042 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/recovered.edits] 2023-02-08 13:03:24,043 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/recovered.edits] 2023-02-08 13:03:24,043 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/recovered.edits] 2023-02-08 13:03:24,043 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/recovered.edits] 2023-02-08 13:03:24,044 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/recovered.edits] 2023-02-08 13:03:24,044 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/recovered.edits] 2023-02-08 13:03:24,051 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1/096120138ba0445aa48e7ce17439827a to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1/096120138ba0445aa48e7ce17439827a 2023-02-08 13:03:24,051 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1/08a81b0941644c56b86cfb5a81cda73a to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1/08a81b0941644c56b86cfb5a81cda73a 2023-02-08 13:03:24,051 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1/b53adea9d4c34bde9ec50714001cafa2 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1/b53adea9d4c34bde9ec50714001cafa2 2023-02-08 13:03:24,052 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1/5645e6bf911e4bb5b92ab5119e735258 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1/5645e6bf911e4bb5b92ab5119e735258 2023-02-08 13:03:24,052 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1/880d1fd26f5941d8afe2b08bc9173f4c to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1/880d1fd26f5941d8afe2b08bc9173f4c 2023-02-08 13:03:24,052 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1/00a1b1a191cf43c2b771f4fe067e3a2e to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1/00a1b1a191cf43c2b771f4fe067e3a2e 2023-02-08 13:03:24,053 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1/c6e81182180a4ccf9e324d82c989cfbc to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1/c6e81182180a4ccf9e324d82c989cfbc 2023-02-08 13:03:24,054 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1/7b4097d4ec344243ab0ac7ce3c84cf0e to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f1/7b4097d4ec344243ab0ac7ce3c84cf0e 2023-02-08 13:03:24,054 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1/f5e33f40b3b94797b1e2c9496fcab368 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f1/f5e33f40b3b94797b1e2c9496fcab368 2023-02-08 13:03:24,054 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1/2f0090914a254c35832f326d7ea66dcf to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f1/2f0090914a254c35832f326d7ea66dcf 2023-02-08 13:03:24,055 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1/0de744fd111e49ce96c91eeec1489344 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f1/0de744fd111e49ce96c91eeec1489344 2023-02-08 13:03:24,055 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1/94f75decce31492e821393938e809f3e to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f1/94f75decce31492e821393938e809f3e 2023-02-08 13:03:24,055 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1/e5e7ea1ce3b947f68e95864ede66541d to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f1/e5e7ea1ce3b947f68e95864ede66541d 2023-02-08 13:03:24,055 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690/recovered.edits/6.seqid to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690/recovered.edits/6.seqid 2023-02-08 13:03:24,057 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e34a05f1123d6630f6f06db6da6b690 2023-02-08 13:03:24,057 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:24,057 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1/ca114ea02de045ccae123af66a38e667 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f1/ca114ea02de045ccae123af66a38e667 2023-02-08 13:03:24,060 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2/3ce77d5fce5a4ab1a2bd3e97cb29f8f3 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2/3ce77d5fce5a4ab1a2bd3e97cb29f8f3 2023-02-08 13:03:24,060 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2/3616e1cd449c4b42a8d80457c3c3234f to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2/3616e1cd449c4b42a8d80457c3c3234f 2023-02-08 13:03:24,060 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2/cbb4764ea5da4ab8a5e089a0e72c08e9 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2/cbb4764ea5da4ab8a5e089a0e72c08e9 2023-02-08 13:03:24,061 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2/1c027c19e86e4d97946ffe7325606f6a to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2/1c027c19e86e4d97946ffe7325606f6a 2023-02-08 13:03:24,061 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2/0b13c3b705a44294b0072f1f498d5180 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2/0b13c3b705a44294b0072f1f498d5180 2023-02-08 13:03:24,061 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2/146487b65e5c44fcaf669d1e8cb26bdf to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2/146487b65e5c44fcaf669d1e8cb26bdf 2023-02-08 13:03:24,062 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/recovered.edits] 2023-02-08 13:03:24,063 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2/3ee8346a8a63453fa89634710fa0d539 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/f2/3ee8346a8a63453fa89634710fa0d539 2023-02-08 13:03:24,063 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2/dbf71a0252b148c6a53bb5c653743f01 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/f2/dbf71a0252b148c6a53bb5c653743f01 2023-02-08 13:03:24,063 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2/de7160c650e748c4bc072d50cf757fc7 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/f2/de7160c650e748c4bc072d50cf757fc7 2023-02-08 13:03:24,063 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2/aec40c5b28604e50abb40277d193ff1c to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2/aec40c5b28604e50abb40277d193ff1c 2023-02-08 13:03:24,064 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2/bba2338b2f2d4955bd99cb79aa2daf11 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/f2/bba2338b2f2d4955bd99cb79aa2daf11 2023-02-08 13:03:24,064 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2/37bcce66432b4b2baa066344c688886b to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/f2/37bcce66432b4b2baa066344c688886b 2023-02-08 13:03:24,065 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2/791ad15a78a2447a8208da136e611288 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/f2/791ad15a78a2447a8208da136e611288 2023-02-08 13:03:24,077 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2/b63b01ed02f7448f8ba4b6f562ca0246 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/f2/b63b01ed02f7448f8ba4b6f562ca0246 2023-02-08 13:03:24,077 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/recovered.edits/12.seqid to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140/recovered.edits/12.seqid 2023-02-08 13:03:24,079 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/a483102b691671503ad7e7727d21c140 2023-02-08 13:03:24,079 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:24,079 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/recovered.edits/12.seqid to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039/recovered.edits/12.seqid 2023-02-08 13:03:24,080 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1/640084068fe04bbb90889b972da2fbfb to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1/640084068fe04bbb90889b972da2fbfb 2023-02-08 13:03:24,080 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/recovered.edits/12.seqid to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01/recovered.edits/12.seqid 2023-02-08 13:03:24,080 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/f34bf6256167e7e68f1aee5b33d38039 2023-02-08 13:03:24,082 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/recovered.edits/12.seqid to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71/recovered.edits/12.seqid 2023-02-08 13:03:24,082 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/recovered.edits/12.seqid to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629/recovered.edits/12.seqid 2023-02-08 13:03:24,082 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/14b62f8b8e0b4b3a0a607fbbaafc0d01 2023-02-08 13:03:24,082 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b4e8cbd16c49c254c64e02f036e9aa71 2023-02-08 13:03:24,082 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/recovered.edits/12.seqid to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2/recovered.edits/12.seqid 2023-02-08 13:03:24,083 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/af105189d7e976ff1119f2d054c2d629 2023-02-08 13:03:24,083 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6/f1, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6/f2, FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6/recovered.edits] 2023-02-08 13:03:24,083 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1/d2574f74eab94061bec46d7f85d13744 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f1/d2574f74eab94061bec46d7f85d13744 2023-02-08 13:03:24,083 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/5fa62d397beda9fc152ed91752b959e2 2023-02-08 13:03:24,084 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/recovered.edits/12.seqid to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505/recovered.edits/12.seqid 2023-02-08 13:03:24,085 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/efce11bf79d10a7a0e0ca8c92802c505 2023-02-08 13:03:24,086 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2/55e0257f726640e6ac1ef9c92fe868ec to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2/55e0257f726640e6ac1ef9c92fe868ec 2023-02-08 13:03:24,088 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2/572f3f4865804be0b932a15265c6dc54 to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/f2/572f3f4865804be0b932a15265c6dc54 2023-02-08 13:03:24,088 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6/recovered.edits/6.seqid to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6/recovered.edits/6.seqid 2023-02-08 13:03:24,089 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/1dedfa6ce0377768d24a0625a5bf81f6 2023-02-08 13:03:24,091 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/recovered.edits/12.seqid to hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/archive/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968/recovered.edits/12.seqid 2023-02-08 13:03:24,091 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/.tmp/data/default/testWithMockedMapReduceMultiRegion/b0affe31618e6bfe674fdedfa4e15968 2023-02-08 13:03:24,091 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-08 13:03:24,093 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:24,096 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-08 13:03:24,099 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-08 13:03:24,099 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:24,100 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-08 13:03:24,100 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861404100"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:24,100 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861404100"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:24,100 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675861399938.a483102b691671503ad7e7727d21c140.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861404100"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:24,100 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861404100"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:24,100 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861404100"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:24,100 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861404100"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:24,100 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861404100"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:24,100 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861404100"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:24,100 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861404100"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:24,100 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861404100"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:24,102 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-08 13:03:24,102 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6e34a05f1123d6630f6f06db6da6b690, NAME => 'testWithMockedMapReduceMultiRegion,,1675861399938.6e34a05f1123d6630f6f06db6da6b690.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => b4e8cbd16c49c254c64e02f036e9aa71, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675861399938.b4e8cbd16c49c254c64e02f036e9aa71.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => a483102b691671503ad7e7727d21c140, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675861399938.a483102b691671503ad7e7727d21c140.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 14b62f8b8e0b4b3a0a607fbbaafc0d01, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675861399938.14b62f8b8e0b4b3a0a607fbbaafc0d01.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => af105189d7e976ff1119f2d054c2d629, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675861399938.af105189d7e976ff1119f2d054c2d629.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => f34bf6256167e7e68f1aee5b33d38039, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675861399938.f34bf6256167e7e68f1aee5b33d38039.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 5fa62d397beda9fc152ed91752b959e2, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675861399938.5fa62d397beda9fc152ed91752b959e2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => efce11bf79d10a7a0e0ca8c92802c505, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675861399938.efce11bf79d10a7a0e0ca8c92802c505.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => b0affe31618e6bfe674fdedfa4e15968, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675861399938.b0affe31618e6bfe674fdedfa4e15968.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 1dedfa6ce0377768d24a0625a5bf81f6, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675861399938.1dedfa6ce0377768d24a0625a5bf81f6.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-08 13:03:24,102 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-08 13:03:24,102 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675861404102"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:24,103 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-08 13:03:24,105 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-08 13:03:24,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 80 msec 2023-02-08 13:03:24,129 INFO [Listener at localhost/33639] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:24,129 INFO [Listener at localhost/33639] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:24,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44573] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-08 13:03:24,130 INFO [Listener at localhost/33639] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-08 13:03:24,130 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 13:03:24,130 INFO [Listener at localhost/33639] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 13:03:24,131 DEBUG [Listener at localhost/33639] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x354ff4d2 to 127.0.0.1:51700 2023-02-08 13:03:24,131 DEBUG [Listener at localhost/33639] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:24,131 DEBUG [Listener at localhost/33639] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 13:03:24,131 DEBUG [Listener at localhost/33639] util.JVMClusterUtil(257): Found active master hash=441686145, stopped=false 2023-02-08 13:03:24,131 INFO [Listener at localhost/33639] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44573,1675861398623 2023-02-08 13:03:24,133 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:24,133 INFO [Listener at localhost/33639] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 13:03:24,133 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:24,133 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:24,133 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:24,135 DEBUG [Listener at localhost/33639] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x338ef415 to 127.0.0.1:51700 2023-02-08 13:03:24,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:24,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:24,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:24,135 DEBUG [Listener at localhost/33639] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:24,135 INFO [Listener at localhost/33639] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43751,1675861398672' ***** 2023-02-08 13:03:24,135 INFO [Listener at localhost/33639] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:24,135 INFO [Listener at localhost/33639] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40069,1675861398701' ***** 2023-02-08 13:03:24,135 INFO [Listener at localhost/33639] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:24,135 INFO [RS:0;jenkins-hbase4:43751] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:24,135 INFO [RS:0;jenkins-hbase4:43751] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:24,136 INFO [RS:0;jenkins-hbase4:43751] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:24,136 INFO [RS:1;jenkins-hbase4:40069] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:24,136 INFO [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(3304): Received CLOSE for fa787723ccc9dc79ae40b0d2b1ff3afd 2023-02-08 13:03:24,136 INFO [RS:1;jenkins-hbase4:40069] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:24,136 INFO [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:24,136 DEBUG [RS:0;jenkins-hbase4:43751] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22d0d138 to 127.0.0.1:51700 2023-02-08 13:03:24,136 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:24,137 DEBUG [RS:0;jenkins-hbase4:43751] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:24,138 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:24,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fa787723ccc9dc79ae40b0d2b1ff3afd, disabling compactions & flushes 2023-02-08 13:03:24,136 INFO [RS:1;jenkins-hbase4:40069] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:24,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. 2023-02-08 13:03:24,138 INFO [RS:0;jenkins-hbase4:43751] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:24,138 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:24,139 INFO [RS:0;jenkins-hbase4:43751] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:24,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. 2023-02-08 13:03:24,139 INFO [RS:1;jenkins-hbase4:40069] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:24,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. after waiting 0 ms 2023-02-08 13:03:24,140 DEBUG [RS:1;jenkins-hbase4:40069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x625a4763 to 127.0.0.1:51700 2023-02-08 13:03:24,140 INFO [RS:0;jenkins-hbase4:43751] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:24,140 DEBUG [RS:1;jenkins-hbase4:40069] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:24,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. 2023-02-08 13:03:24,140 INFO [RS:1;jenkins-hbase4:40069] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40069,1675861398701; all regions closed. 2023-02-08 13:03:24,140 INFO [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 13:03:24,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing fa787723ccc9dc79ae40b0d2b1ff3afd 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 13:03:24,141 INFO [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-08 13:03:24,141 DEBUG [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, fa787723ccc9dc79ae40b0d2b1ff3afd=hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd.} 2023-02-08 13:03:24,141 DEBUG [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(1505): Waiting on 1588230740, fa787723ccc9dc79ae40b0d2b1ff3afd 2023-02-08 13:03:24,143 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:03:24,143 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:03:24,143 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:03:24,143 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:03:24,144 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:03:24,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-08 13:03:24,147 DEBUG [RS:1;jenkins-hbase4:40069] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/oldWALs 2023-02-08 13:03:24,147 INFO [RS:1;jenkins-hbase4:40069] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40069%2C1675861398701:(num 1675861400045) 2023-02-08 13:03:24,147 DEBUG [RS:1;jenkins-hbase4:40069] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:24,147 INFO [RS:1;jenkins-hbase4:40069] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:24,148 INFO [RS:1;jenkins-hbase4:40069] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:24,148 INFO [RS:1;jenkins-hbase4:40069] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:24,148 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:24,148 INFO [RS:1;jenkins-hbase4:40069] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:24,148 INFO [RS:1;jenkins-hbase4:40069] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:24,149 INFO [RS:1;jenkins-hbase4:40069] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40069 2023-02-08 13:03:24,154 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:24,154 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:24,154 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40069,1675861398701 2023-02-08 13:03:24,154 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:24,154 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:24,156 ERROR [Listener at localhost/33639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@167c0248 rejected from java.util.concurrent.ThreadPoolExecutor@1243845f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:24,157 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40069,1675861398701] 2023-02-08 13:03:24,157 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40069,1675861398701; numProcessing=1 2023-02-08 13:03:24,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/.tmp/info/900e3cee556742608027cd6d72aa4b37 2023-02-08 13:03:24,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/namespace/fa787723ccc9dc79ae40b0d2b1ff3afd/.tmp/info/1a402b9b8a3f4a31bdc90ec5f9bb21d7 2023-02-08 13:03:24,164 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 900e3cee556742608027cd6d72aa4b37 2023-02-08 13:03:24,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/namespace/fa787723ccc9dc79ae40b0d2b1ff3afd/.tmp/info/1a402b9b8a3f4a31bdc90ec5f9bb21d7 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/namespace/fa787723ccc9dc79ae40b0d2b1ff3afd/info/1a402b9b8a3f4a31bdc90ec5f9bb21d7 2023-02-08 13:03:24,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/namespace/fa787723ccc9dc79ae40b0d2b1ff3afd/info/1a402b9b8a3f4a31bdc90ec5f9bb21d7, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 13:03:24,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fa787723ccc9dc79ae40b0d2b1ff3afd in 30ms, sequenceid=6, compaction requested=false 2023-02-08 13:03:24,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/.tmp/rep_barrier/8593ee1fded54a1095e2bf32fbfd5903 2023-02-08 13:03:24,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/namespace/fa787723ccc9dc79ae40b0d2b1ff3afd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 13:03:24,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. 2023-02-08 13:03:24,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fa787723ccc9dc79ae40b0d2b1ff3afd: Waiting for close lock at 1675861404136Running coprocessor pre-close hooks at 1675861404136Disabling compacts and flushes for region at 1675861404136Disabling writes for close at 1675861404140 (+4 ms)Obtaining lock to block concurrent updates at 1675861404140Preparing flush snapshotting stores in fa787723ccc9dc79ae40b0d2b1ff3afd at 1675861404140Finished memstore snapshotting hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675861404141 (+1 ms)Flushing stores of hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. at 1675861404144 (+3 ms)Flushing fa787723ccc9dc79ae40b0d2b1ff3afd/info: creating writer at 1675861404144Flushing fa787723ccc9dc79ae40b0d2b1ff3afd/info: appending metadata at 1675861404147 (+3 ms)Flushing fa787723ccc9dc79ae40b0d2b1ff3afd/info: closing flushed file at 1675861404147Flushing fa787723ccc9dc79ae40b0d2b1ff3afd/info: reopening flushed file at 1675861404166 (+19 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fa787723ccc9dc79ae40b0d2b1ff3afd in 30ms, sequenceid=6, compaction requested=false at 1675861404170 (+4 ms)Writing region close event to WAL at 1675861404171 (+1 ms)Running coprocessor post-close hooks at 1675861404174 (+3 ms)Closed at 1675861404175 (+1 ms) 2023-02-08 13:03:24,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675861399289.fa787723ccc9dc79ae40b0d2b1ff3afd. 2023-02-08 13:03:24,177 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8593ee1fded54a1095e2bf32fbfd5903 2023-02-08 13:03:24,183 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/.tmp/table/ee29ed31c2d34ae395da4196c5a6c1ff 2023-02-08 13:03:24,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee29ed31c2d34ae395da4196c5a6c1ff 2023-02-08 13:03:24,187 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/.tmp/info/900e3cee556742608027cd6d72aa4b37 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/info/900e3cee556742608027cd6d72aa4b37 2023-02-08 13:03:24,190 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 900e3cee556742608027cd6d72aa4b37 2023-02-08 13:03:24,190 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/info/900e3cee556742608027cd6d72aa4b37, entries=30, sequenceid=57, filesize=8.3 K 2023-02-08 13:03:24,191 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/.tmp/rep_barrier/8593ee1fded54a1095e2bf32fbfd5903 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/rep_barrier/8593ee1fded54a1095e2bf32fbfd5903 2023-02-08 13:03:24,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8593ee1fded54a1095e2bf32fbfd5903 2023-02-08 13:03:24,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/rep_barrier/8593ee1fded54a1095e2bf32fbfd5903, entries=10, sequenceid=57, filesize=6.1 K 2023-02-08 13:03:24,196 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/.tmp/table/ee29ed31c2d34ae395da4196c5a6c1ff as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/table/ee29ed31c2d34ae395da4196c5a6c1ff 2023-02-08 13:03:24,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee29ed31c2d34ae395da4196c5a6c1ff 2023-02-08 13:03:24,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/table/ee29ed31c2d34ae395da4196c5a6c1ff, entries=13, sequenceid=57, filesize=6.1 K 2023-02-08 13:03:24,200 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=57, compaction requested=false 2023-02-08 13:03:24,203 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-08 13:03:24,203 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 13:03:24,204 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:24,204 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861404141Running coprocessor pre-close hooks at 1675861404141Disabling compacts and flushes for region at 1675861404141Disabling writes for close at 1675861404143 (+2 ms)Obtaining lock to block concurrent updates at 1675861404144 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1675861404144Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1675861404144Flushing stores of hbase:meta,,1.1588230740 at 1675861404145 (+1 ms)Flushing 1588230740/info: creating writer at 1675861404145Flushing 1588230740/info: appending metadata at 1675861404148 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675861404148Flushing 1588230740/rep_barrier: creating writer at 1675861404164 (+16 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675861404167 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675861404167Flushing 1588230740/table: creating writer at 1675861404177 (+10 ms)Flushing 1588230740/table: appending metadata at 1675861404178 (+1 ms)Flushing 1588230740/table: closing flushed file at 1675861404178Flushing 1588230740/info: reopening flushed file at 1675861404187 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675861404192 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675861404196 (+4 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=57, compaction requested=false at 1675861404200 (+4 ms)Writing region close event to WAL at 1675861404201 (+1 ms)Running coprocessor post-close hooks at 1675861404203 (+2 ms)Closed at 1675861404204 (+1 ms) 2023-02-08 13:03:24,204 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:24,234 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:24,257 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:24,257 INFO [RS:1;jenkins-hbase4:40069] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40069,1675861398701; zookeeper connection closed. 2023-02-08 13:03:24,257 ERROR [Listener at localhost/33639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10c45723 rejected from java.util.concurrent.ThreadPoolExecutor@1243845f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:24,258 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@770c276f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@770c276f 2023-02-08 13:03:24,258 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:40069-0x10034077e110002, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:24,258 ERROR [Listener at localhost/33639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@683378d9 rejected from java.util.concurrent.ThreadPoolExecutor@1243845f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:24,259 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40069,1675861398701 already deleted, retry=false 2023-02-08 13:03:24,259 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40069,1675861398701 expired; onlineServers=1 2023-02-08 13:03:24,341 INFO [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43751,1675861398672; all regions closed. 2023-02-08 13:03:24,345 DEBUG [RS:0;jenkins-hbase4:43751] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/oldWALs 2023-02-08 13:03:24,345 INFO [RS:0;jenkins-hbase4:43751] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43751%2C1675861398672.meta:.meta(num 1675861399237) 2023-02-08 13:03:24,351 DEBUG [RS:0;jenkins-hbase4:43751] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/oldWALs 2023-02-08 13:03:24,351 INFO [RS:0;jenkins-hbase4:43751] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43751%2C1675861398672:(num 1675861399667) 2023-02-08 13:03:24,351 DEBUG [RS:0;jenkins-hbase4:43751] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:24,351 INFO [RS:0;jenkins-hbase4:43751] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:24,352 INFO [RS:0;jenkins-hbase4:43751] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:24,352 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:24,353 INFO [RS:0;jenkins-hbase4:43751] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43751 2023-02-08 13:03:24,354 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43751,1675861398672 2023-02-08 13:03:24,354 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:24,354 ERROR [Listener at localhost/33639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68fe042e rejected from java.util.concurrent.ThreadPoolExecutor@6cc19de9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:24,355 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43751,1675861398672] 2023-02-08 13:03:24,355 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43751,1675861398672; numProcessing=2 2023-02-08 13:03:24,356 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43751,1675861398672 already deleted, retry=false 2023-02-08 13:03:24,356 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43751,1675861398672 expired; onlineServers=0 2023-02-08 13:03:24,356 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44573,1675861398623' ***** 2023-02-08 13:03:24,356 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 13:03:24,357 DEBUG [M:0;jenkins-hbase4:44573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e6c1f13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:24,357 INFO [M:0;jenkins-hbase4:44573] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44573,1675861398623 2023-02-08 13:03:24,357 INFO [M:0;jenkins-hbase4:44573] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44573,1675861398623; all regions closed. 2023-02-08 13:03:24,357 DEBUG [M:0;jenkins-hbase4:44573] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:24,357 DEBUG [M:0;jenkins-hbase4:44573] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 13:03:24,357 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 13:03:24,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861398874] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861398874,5,FailOnTimeoutGroup] 2023-02-08 13:03:24,357 DEBUG [M:0;jenkins-hbase4:44573] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 13:03:24,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861398878] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861398878,5,FailOnTimeoutGroup] 2023-02-08 13:03:24,358 INFO [M:0;jenkins-hbase4:44573] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 13:03:24,359 INFO [M:0;jenkins-hbase4:44573] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 13:03:24,359 INFO [M:0;jenkins-hbase4:44573] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 13:03:24,359 DEBUG [M:0;jenkins-hbase4:44573] master.HMaster(1502): Stopping service threads 2023-02-08 13:03:24,359 INFO [M:0;jenkins-hbase4:44573] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 13:03:24,360 ERROR [M:0;jenkins-hbase4:44573] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-08 13:03:24,360 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:24,360 INFO [M:0;jenkins-hbase4:44573] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 13:03:24,360 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:24,360 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 13:03:24,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:24,360 DEBUG [M:0;jenkins-hbase4:44573] zookeeper.ZKUtil(398): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 13:03:24,360 WARN [M:0;jenkins-hbase4:44573] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 13:03:24,360 INFO [M:0;jenkins-hbase4:44573] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 13:03:24,361 INFO [M:0;jenkins-hbase4:44573] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 13:03:24,361 DEBUG [M:0;jenkins-hbase4:44573] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:03:24,361 INFO [M:0;jenkins-hbase4:44573] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:24,361 DEBUG [M:0;jenkins-hbase4:44573] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:24,361 DEBUG [M:0;jenkins-hbase4:44573] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:03:24,361 DEBUG [M:0;jenkins-hbase4:44573] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:24,361 INFO [M:0;jenkins-hbase4:44573] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.11 KB heapSize=200.02 KB 2023-02-08 13:03:24,369 INFO [M:0;jenkins-hbase4:44573] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.11 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/441b40deed2746e7bc2cd6d6a5b92347 2023-02-08 13:03:24,373 DEBUG [M:0;jenkins-hbase4:44573] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/441b40deed2746e7bc2cd6d6a5b92347 as hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/441b40deed2746e7bc2cd6d6a5b92347 2023-02-08 13:03:24,377 INFO [M:0;jenkins-hbase4:44573] regionserver.HStore(1080): Added hdfs://localhost:36581/user/jenkins/test-data/8392e4ac-cd33-6423-a166-245bbb090a47/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/441b40deed2746e7bc2cd6d6a5b92347, entries=53, sequenceid=357, filesize=10.7 K 2023-02-08 13:03:24,377 INFO [M:0;jenkins-hbase4:44573] regionserver.HRegion(2947): Finished flush of dataSize ~167.11 KB/171119, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-08 13:03:24,378 INFO [M:0;jenkins-hbase4:44573] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:24,378 DEBUG [M:0;jenkins-hbase4:44573] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861404361Disabling compacts and flushes for region at 1675861404361Disabling writes for close at 1675861404361Obtaining lock to block concurrent updates at 1675861404361Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675861404361Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171119, getHeapSize=204800, getOffHeapSize=0, getCellsCount=442 at 1675861404361Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675861404362 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675861404363 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675861404365 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675861404365Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675861404373 (+8 ms)Finished flush of dataSize ~167.11 KB/171119, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false at 1675861404377 (+4 ms)Writing region close event to WAL at 1675861404378 (+1 ms)Closed at 1675861404378 2023-02-08 13:03:24,380 INFO [M:0;jenkins-hbase4:44573] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 13:03:24,380 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:24,381 INFO [M:0;jenkins-hbase4:44573] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44573 2023-02-08 13:03:24,383 DEBUG [M:0;jenkins-hbase4:44573] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44573,1675861398623 already deleted, retry=false 2023-02-08 13:03:24,635 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:24,635 INFO [M:0;jenkins-hbase4:44573] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44573,1675861398623; zookeeper connection closed. 2023-02-08 13:03:24,635 ERROR [Listener at localhost/33639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@17b24ee1 rejected from java.util.concurrent.ThreadPoolExecutor@138dd8cf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:24,636 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): master:44573-0x10034077e110000, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:24,636 ERROR [Listener at localhost/33639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@62d3fdff rejected from java.util.concurrent.ThreadPoolExecutor@138dd8cf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:24,735 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:24,735 INFO [RS:0;jenkins-hbase4:43751] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43751,1675861398672; zookeeper connection closed. 2023-02-08 13:03:24,735 ERROR [Listener at localhost/33639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@e7a88a rejected from java.util.concurrent.ThreadPoolExecutor@6cc19de9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:24,735 DEBUG [Listener at localhost/33639-EventThread] zookeeper.ZKWatcher(600): regionserver:43751-0x10034077e110001, quorum=127.0.0.1:51700, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:24,735 ERROR [Listener at localhost/33639-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@78eefbf4 rejected from java.util.concurrent.ThreadPoolExecutor@6cc19de9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:24,735 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4723134c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4723134c 2023-02-08 13:03:24,737 INFO [Listener at localhost/33639] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 13:03:24,737 WARN [Listener at localhost/33639] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:24,740 INFO [Listener at localhost/33639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:24,849 WARN [BP-1230589443-172.31.14.131-1675861398058 heartbeating to localhost/127.0.0.1:36581] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:24,849 WARN [BP-1230589443-172.31.14.131-1675861398058 heartbeating to localhost/127.0.0.1:36581] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1230589443-172.31.14.131-1675861398058 (Datanode Uuid b5d265a7-cc9e-41b3-a9b5-a900178ee2ee) service to localhost/127.0.0.1:36581 2023-02-08 13:03:24,850 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/cluster_9693065a-f2aa-7f1f-de25-8aa5b9c2e8e8/dfs/data/data3/current/BP-1230589443-172.31.14.131-1675861398058] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:24,850 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/cluster_9693065a-f2aa-7f1f-de25-8aa5b9c2e8e8/dfs/data/data4/current/BP-1230589443-172.31.14.131-1675861398058] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:24,852 WARN [Listener at localhost/33639] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:24,854 INFO [Listener at localhost/33639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:24,963 WARN [BP-1230589443-172.31.14.131-1675861398058 heartbeating to localhost/127.0.0.1:36581] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:24,963 WARN [BP-1230589443-172.31.14.131-1675861398058 heartbeating to localhost/127.0.0.1:36581] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1230589443-172.31.14.131-1675861398058 (Datanode Uuid 1ae7b4dc-d727-45b9-b610-dc14b391a530) service to localhost/127.0.0.1:36581 2023-02-08 13:03:24,964 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/cluster_9693065a-f2aa-7f1f-de25-8aa5b9c2e8e8/dfs/data/data1/current/BP-1230589443-172.31.14.131-1675861398058] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:24,964 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/cluster_9693065a-f2aa-7f1f-de25-8aa5b9c2e8e8/dfs/data/data2/current/BP-1230589443-172.31.14.131-1675861398058] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:24,973 INFO [Listener at localhost/33639] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:25,092 INFO [Listener at localhost/33639] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 13:03:25,128 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 13:03:25,142 INFO [Listener at localhost/33639] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=228 (was 178) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:36581 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33639 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:36581 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/33639.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36581 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:36581 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33639.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:36581 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44573,1675861398623)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:36581 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/33639.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:36581 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33639.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/33639.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33639.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/33639.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33639.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/33639.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33639.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=637 (was 571) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=293 (was 310), ProcessCount=165 (was 165), AvailableMemoryMB=3919 (was 4082) 2023-02-08 13:03:25,152 INFO [Listener at localhost/33639] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=228, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=293, ProcessCount=165, AvailableMemoryMB=3919 2023-02-08 13:03:25,162 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/hadoop.log.dir so I do NOT create it in target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5 2023-02-08 13:03:25,162 WARN [Listener at localhost/33639] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/hadoop.log.dir Erasing configuration value by system value. 2023-02-08 13:03:25,162 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/hadoop.tmp.dir so I do NOT create it in target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5 2023-02-08 13:03:25,162 WARN [Listener at localhost/33639] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee666185-c475-5e24-38ce-98f6581844f5/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-08 13:03:25,163 DEBUG [Listener at localhost/33639] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5 2023-02-08 13:03:25,163 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 13:03:25,163 INFO [Listener at localhost/33639] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/cluster_ceb6ad05-198c-9b4f-3bbc-970b0a8b25f2, deleteOnExit=true 2023-02-08 13:03:25,163 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 13:03:25,163 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/test.cache.data in system properties and HBase conf 2023-02-08 13:03:25,163 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 13:03:25,163 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/hadoop.log.dir in system properties and HBase conf 2023-02-08 13:03:25,163 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 13:03:25,163 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 13:03:25,163 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 13:03:25,164 DEBUG [Listener at localhost/33639] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 13:03:25,164 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:03:25,164 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:03:25,164 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 13:03:25,164 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:03:25,164 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 13:03:25,164 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 13:03:25,164 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:03:25,164 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:03:25,165 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 13:03:25,165 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/nfs.dump.dir in system properties and HBase conf 2023-02-08 13:03:25,165 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/java.io.tmpdir in system properties and HBase conf 2023-02-08 13:03:25,165 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:03:25,165 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 13:03:25,165 INFO [Listener at localhost/33639] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 13:03:25,169 WARN [Listener at localhost/33639] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:03:25,169 WARN [Listener at localhost/33639] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:03:25,212 WARN [Listener at localhost/33639] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:25,214 INFO [Listener at localhost/33639] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:25,219 INFO [Listener at localhost/33639] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/java.io.tmpdir/Jetty_localhost_34583_hdfs____6rrp21/webapp 2023-02-08 13:03:25,310 INFO [Listener at localhost/33639] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34583 2023-02-08 13:03:25,314 WARN [Listener at localhost/33639] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:03:25,314 WARN [Listener at localhost/33639] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:03:25,362 WARN [Listener at localhost/34847] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:25,380 WARN [Listener at localhost/34847] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:03:25,384 WARN [Listener at localhost/34847] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:25,385 INFO [Listener at localhost/34847] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:25,389 INFO [Listener at localhost/34847] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/java.io.tmpdir/Jetty_localhost_38389_datanode____tie6hi/webapp 2023-02-08 13:03:25,481 INFO [Listener at localhost/34847] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38389 2023-02-08 13:03:25,488 WARN [Listener at localhost/41823] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:25,504 WARN [Listener at localhost/41823] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:03:25,507 WARN [Listener at localhost/41823] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:25,508 INFO [Listener at localhost/41823] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:25,513 INFO [Listener at localhost/41823] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/java.io.tmpdir/Jetty_localhost_34241_datanode____.vg39bf/webapp 2023-02-08 13:03:25,588 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x723bd421b9e88dcc: Processing first storage report for DS-ee71b14c-7387-473b-b780-eb3503a6afbb from datanode e1dd6ab2-44a6-4434-b7b8-196ea4ea4845 2023-02-08 13:03:25,588 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x723bd421b9e88dcc: from storage DS-ee71b14c-7387-473b-b780-eb3503a6afbb node DatanodeRegistration(127.0.0.1:42843, datanodeUuid=e1dd6ab2-44a6-4434-b7b8-196ea4ea4845, infoPort=32955, infoSecurePort=0, ipcPort=41823, storageInfo=lv=-57;cid=testClusterID;nsid=1695795337;c=1675861405171), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:25,588 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x723bd421b9e88dcc: Processing first storage report for DS-a5d01efe-c253-416a-b81f-5e8c8462e94d from datanode e1dd6ab2-44a6-4434-b7b8-196ea4ea4845 2023-02-08 13:03:25,588 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x723bd421b9e88dcc: from storage DS-a5d01efe-c253-416a-b81f-5e8c8462e94d node DatanodeRegistration(127.0.0.1:42843, datanodeUuid=e1dd6ab2-44a6-4434-b7b8-196ea4ea4845, infoPort=32955, infoSecurePort=0, ipcPort=41823, storageInfo=lv=-57;cid=testClusterID;nsid=1695795337;c=1675861405171), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:25,612 INFO [Listener at localhost/41823] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34241 2023-02-08 13:03:25,624 WARN [Listener at localhost/37759] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:25,735 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf870072983bce65e: Processing first storage report for DS-8acd85d6-733d-4c55-9fb6-562968dc1287 from datanode dd078dba-9a64-4e2e-8649-29bfaa149b40 2023-02-08 13:03:25,735 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf870072983bce65e: from storage DS-8acd85d6-733d-4c55-9fb6-562968dc1287 node DatanodeRegistration(127.0.0.1:42021, datanodeUuid=dd078dba-9a64-4e2e-8649-29bfaa149b40, infoPort=44491, infoSecurePort=0, ipcPort=37759, storageInfo=lv=-57;cid=testClusterID;nsid=1695795337;c=1675861405171), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:25,735 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf870072983bce65e: Processing first storage report for DS-4ccc13a0-ea64-44f9-9f4e-a0c006c6b565 from datanode dd078dba-9a64-4e2e-8649-29bfaa149b40 2023-02-08 13:03:25,735 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf870072983bce65e: from storage DS-4ccc13a0-ea64-44f9-9f4e-a0c006c6b565 node DatanodeRegistration(127.0.0.1:42021, datanodeUuid=dd078dba-9a64-4e2e-8649-29bfaa149b40, infoPort=44491, infoSecurePort=0, ipcPort=37759, storageInfo=lv=-57;cid=testClusterID;nsid=1695795337;c=1675861405171), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:25,835 DEBUG [Listener at localhost/37759] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5 2023-02-08 13:03:25,837 INFO [Listener at localhost/37759] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/cluster_ceb6ad05-198c-9b4f-3bbc-970b0a8b25f2/zookeeper_0, clientPort=51359, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/cluster_ceb6ad05-198c-9b4f-3bbc-970b0a8b25f2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/cluster_ceb6ad05-198c-9b4f-3bbc-970b0a8b25f2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 13:03:25,838 INFO [Listener at localhost/37759] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51359 2023-02-08 13:03:25,838 INFO [Listener at localhost/37759] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:25,839 INFO [Listener at localhost/37759] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:25,851 INFO [Listener at localhost/37759] util.FSUtils(479): Created version file at hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4 with version=8 2023-02-08 13:03:25,851 INFO [Listener at localhost/37759] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:25,852 INFO [Listener at localhost/37759] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:25,854 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34847/user/jenkins/test-data/2211e2a5-05ea-e373-23d9-eb318a6a6ea8/hbase-staging 2023-02-08 13:03:25,855 INFO [Listener at localhost/37759] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:25,856 INFO [Listener at localhost/37759] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:25,856 INFO [Listener at localhost/37759] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:25,856 INFO [Listener at localhost/37759] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:25,856 INFO [Listener at localhost/37759] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:25,856 INFO [Listener at localhost/37759] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:25,856 INFO [Listener at localhost/37759] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:25,857 INFO [Listener at localhost/37759] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38399 2023-02-08 13:03:25,857 INFO [Listener at localhost/37759] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:25,858 INFO [Listener at localhost/37759] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:25,858 INFO [Listener at localhost/37759] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38399 connecting to ZooKeeper ensemble=127.0.0.1:51359 2023-02-08 13:03:25,866 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:383990x0, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:25,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38399-0x10034079a510000 connected 2023-02-08 13:03:25,885 DEBUG [Listener at localhost/37759] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:25,885 DEBUG [Listener at localhost/37759] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:25,885 DEBUG [Listener at localhost/37759] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:25,887 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38399 2023-02-08 13:03:25,888 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38399 2023-02-08 13:03:25,889 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38399 2023-02-08 13:03:25,889 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38399 2023-02-08 13:03:25,890 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38399 2023-02-08 13:03:25,890 INFO [Listener at localhost/37759] master.HMaster(439): hbase.rootdir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4, hbase.cluster.distributed=false 2023-02-08 13:03:25,902 INFO [Listener at localhost/37759] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:25,902 INFO [Listener at localhost/37759] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:25,902 INFO [Listener at localhost/37759] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:25,902 INFO [Listener at localhost/37759] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:25,902 INFO [Listener at localhost/37759] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:25,902 INFO [Listener at localhost/37759] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:25,902 INFO [Listener at localhost/37759] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:25,904 INFO [Listener at localhost/37759] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32887 2023-02-08 13:03:25,904 INFO [Listener at localhost/37759] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:03:25,906 DEBUG [Listener at localhost/37759] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:25,907 INFO [Listener at localhost/37759] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:25,908 INFO [Listener at localhost/37759] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:25,908 INFO [Listener at localhost/37759] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32887 connecting to ZooKeeper ensemble=127.0.0.1:51359 2023-02-08 13:03:25,911 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:328870x0, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:25,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:32887-0x10034079a510001 connected 2023-02-08 13:03:25,913 DEBUG [Listener at localhost/37759] zookeeper.ZKUtil(164): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:25,913 DEBUG [Listener at localhost/37759] zookeeper.ZKUtil(164): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:25,914 DEBUG [Listener at localhost/37759] zookeeper.ZKUtil(164): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:25,914 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32887 2023-02-08 13:03:25,914 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32887 2023-02-08 13:03:25,916 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32887 2023-02-08 13:03:25,918 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32887 2023-02-08 13:03:25,918 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32887 2023-02-08 13:03:25,929 INFO [Listener at localhost/37759] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:25,929 INFO [Listener at localhost/37759] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:25,929 INFO [Listener at localhost/37759] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:25,929 INFO [Listener at localhost/37759] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:25,929 INFO [Listener at localhost/37759] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:25,929 INFO [Listener at localhost/37759] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:25,929 INFO [Listener at localhost/37759] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:25,932 INFO [Listener at localhost/37759] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45889 2023-02-08 13:03:25,932 INFO [Listener at localhost/37759] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:03:25,933 DEBUG [Listener at localhost/37759] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:25,933 INFO [Listener at localhost/37759] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:25,934 INFO [Listener at localhost/37759] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:25,935 INFO [Listener at localhost/37759] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45889 connecting to ZooKeeper ensemble=127.0.0.1:51359 2023-02-08 13:03:25,938 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:458890x0, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:25,939 DEBUG [Listener at localhost/37759] zookeeper.ZKUtil(164): regionserver:458890x0, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:25,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45889-0x10034079a510002 connected 2023-02-08 13:03:25,940 DEBUG [Listener at localhost/37759] zookeeper.ZKUtil(164): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:25,940 DEBUG [Listener at localhost/37759] zookeeper.ZKUtil(164): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:25,944 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45889 2023-02-08 13:03:25,948 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45889 2023-02-08 13:03:25,948 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45889 2023-02-08 13:03:25,948 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45889 2023-02-08 13:03:25,949 DEBUG [Listener at localhost/37759] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45889 2023-02-08 13:03:25,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38399,1675861405855 2023-02-08 13:03:25,951 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:03:25,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38399,1675861405855 2023-02-08 13:03:25,953 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:25,953 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:25,953 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:25,954 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:25,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:03:25,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38399,1675861405855 from backup master directory 2023-02-08 13:03:25,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:03:25,957 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38399,1675861405855 2023-02-08 13:03:25,957 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:03:25,957 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:25,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,38399,1675861405855 2023-02-08 13:03:25,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/hbase.id with ID: df9afd2f-1fef-4935-a626-e94fd2eec2ce 2023-02-08 13:03:25,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:25,981 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:25,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x509c2bfc to 127.0.0.1:51359 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:25,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bfbd29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:25,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:25,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 13:03:25,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:25,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/data/master/store-tmp 2023-02-08 13:03:26,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:26,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:03:26,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:26,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:26,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:03:26,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:26,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:26,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861406007Disabling compacts and flushes for region at 1675861406007Disabling writes for close at 1675861406007Writing region close event to WAL at 1675861406007Closed at 1675861406007 2023-02-08 13:03:26,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/WALs/jenkins-hbase4.apache.org,38399,1675861405855 2023-02-08 13:03:26,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38399%2C1675861405855, suffix=, logDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/WALs/jenkins-hbase4.apache.org,38399,1675861405855, archiveDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/oldWALs, maxLogs=10 2023-02-08 13:03:26,030 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42843,DS-ee71b14c-7387-473b-b780-eb3503a6afbb,DISK] 2023-02-08 13:03:26,030 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42021,DS-8acd85d6-733d-4c55-9fb6-562968dc1287,DISK] 2023-02-08 13:03:26,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/WALs/jenkins-hbase4.apache.org,38399,1675861405855/jenkins-hbase4.apache.org%2C38399%2C1675861405855.1675861406010 2023-02-08 13:03:26,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42843,DS-ee71b14c-7387-473b-b780-eb3503a6afbb,DISK], DatanodeInfoWithStorage[127.0.0.1:42021,DS-8acd85d6-733d-4c55-9fb6-562968dc1287,DISK]] 2023-02-08 13:03:26,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:26,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:26,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:26,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:26,033 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:26,034 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 13:03:26,034 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 13:03:26,035 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:26,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:26,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:26,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:26,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:26,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70120530, jitterRate=0.044877320528030396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:03:26,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675861406032Initializing all the Stores at 1675861406033 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861406033Cleaning up temporary data from old regions at 1675861406036 (+3 ms)Cleaning up detritus from prior splits at 1675861406036Region opened successfully at 1675861406039 (+3 ms) 2023-02-08 13:03:26,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 13:03:26,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 13:03:26,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 13:03:26,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 13:03:26,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-08 13:03:26,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-08 13:03:26,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 13:03:26,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 13:03:26,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 13:03:26,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 13:03:26,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 13:03:26,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 13:03:26,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 13:03:26,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 13:03:26,056 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:26,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 13:03:26,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 13:03:26,057 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 13:03:26,058 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:26,058 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:26,058 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:26,058 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:26,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,38399,1675861405855, sessionid=0x10034079a510000, setting cluster-up flag (Was=false) 2023-02-08 13:03:26,063 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:26,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 13:03:26,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38399,1675861405855 2023-02-08 13:03:26,071 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:26,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 13:03:26,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38399,1675861405855 2023-02-08 13:03:26,075 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.hbase-snapshot/.tmp 2023-02-08 13:03:26,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:26,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:26,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:26,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:26,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:26,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 13:03:26,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:26,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675861436079 2023-02-08 13:03:26,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 13:03:26,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 13:03:26,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 13:03:26,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 13:03:26,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 13:03:26,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 13:03:26,079 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:26,079 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 13:03:26,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 13:03:26,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 13:03:26,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 13:03:26,081 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:26,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 13:03:26,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 13:03:26,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861406084,5,FailOnTimeoutGroup] 2023-02-08 13:03:26,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861406085,5,FailOnTimeoutGroup] 2023-02-08 13:03:26,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 13:03:26,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,092 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:26,092 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:26,092 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4 2023-02-08 13:03:26,098 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:26,099 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:03:26,100 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/info 2023-02-08 13:03:26,101 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:03:26,101 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:26,102 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:03:26,103 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:26,103 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:03:26,103 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:26,103 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:03:26,104 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/table 2023-02-08 13:03:26,105 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:03:26,105 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:26,106 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740 2023-02-08 13:03:26,106 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740 2023-02-08 13:03:26,108 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:03:26,109 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:03:26,110 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:26,111 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72585560, jitterRate=0.08160912990570068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:03:26,111 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675861406098Initializing all the Stores at 1675861406099 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861406099Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861406099Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861406099Cleaning up temporary data from old regions at 1675861406107 (+8 ms)Cleaning up detritus from prior splits at 1675861406107Region opened successfully at 1675861406111 (+4 ms) 2023-02-08 13:03:26,111 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:03:26,111 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:03:26,111 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:03:26,111 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:03:26,111 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:03:26,111 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:26,111 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861406111Disabling compacts and flushes for region at 1675861406111Disabling writes for close at 1675861406111Writing region close event to WAL at 1675861406111Closed at 1675861406111 2023-02-08 13:03:26,112 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:26,112 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 13:03:26,112 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 13:03:26,114 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 13:03:26,115 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 13:03:26,151 INFO [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(952): ClusterId : df9afd2f-1fef-4935-a626-e94fd2eec2ce 2023-02-08 13:03:26,151 INFO [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(952): ClusterId : df9afd2f-1fef-4935-a626-e94fd2eec2ce 2023-02-08 13:03:26,151 DEBUG [RS:1;jenkins-hbase4:45889] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:03:26,151 DEBUG [RS:0;jenkins-hbase4:32887] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:03:26,154 DEBUG [RS:1;jenkins-hbase4:45889] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:03:26,154 DEBUG [RS:1;jenkins-hbase4:45889] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:03:26,154 DEBUG [RS:0;jenkins-hbase4:32887] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:03:26,154 DEBUG [RS:0;jenkins-hbase4:32887] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:03:26,156 DEBUG [RS:1;jenkins-hbase4:45889] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:03:26,157 DEBUG [RS:1;jenkins-hbase4:45889] zookeeper.ReadOnlyZKClient(139): Connect 0x06e42e63 to 127.0.0.1:51359 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:26,157 DEBUG [RS:0;jenkins-hbase4:32887] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:03:26,158 DEBUG [RS:0;jenkins-hbase4:32887] zookeeper.ReadOnlyZKClient(139): Connect 0x6a3c8fdf to 127.0.0.1:51359 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:26,165 DEBUG [RS:1;jenkins-hbase4:45889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@823c0cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:26,165 DEBUG [RS:0;jenkins-hbase4:32887] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64fb7ce8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:26,165 DEBUG [RS:1;jenkins-hbase4:45889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c1c4513, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:26,165 DEBUG [RS:0;jenkins-hbase4:32887] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60c4e4af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:26,174 DEBUG [RS:0;jenkins-hbase4:32887] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:32887 2023-02-08 13:03:26,174 DEBUG [RS:1;jenkins-hbase4:45889] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45889 2023-02-08 13:03:26,174 INFO [RS:0;jenkins-hbase4:32887] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:03:26,174 INFO [RS:0;jenkins-hbase4:32887] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:03:26,174 INFO [RS:1;jenkins-hbase4:45889] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:03:26,174 INFO [RS:1;jenkins-hbase4:45889] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:03:26,174 DEBUG [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:03:26,174 DEBUG [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:03:26,174 INFO [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38399,1675861405855 with isa=jenkins-hbase4.apache.org/172.31.14.131:45889, startcode=1675861405928 2023-02-08 13:03:26,174 INFO [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38399,1675861405855 with isa=jenkins-hbase4.apache.org/172.31.14.131:32887, startcode=1675861405901 2023-02-08 13:03:26,175 DEBUG [RS:1;jenkins-hbase4:45889] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:03:26,175 DEBUG [RS:0;jenkins-hbase4:32887] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:03:26,176 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48899, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:03:26,176 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52865, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:03:26,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38399] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:26,178 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:26,179 DEBUG [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4 2023-02-08 13:03:26,179 DEBUG [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34847 2023-02-08 13:03:26,179 DEBUG [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:03:26,179 DEBUG [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4 2023-02-08 13:03:26,179 DEBUG [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34847 2023-02-08 13:03:26,179 DEBUG [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:03:26,180 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:26,182 DEBUG [RS:0;jenkins-hbase4:32887] zookeeper.ZKUtil(162): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:26,182 WARN [RS:0;jenkins-hbase4:32887] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:26,183 INFO [RS:0;jenkins-hbase4:32887] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:26,183 DEBUG [RS:1;jenkins-hbase4:45889] zookeeper.ZKUtil(162): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:26,183 DEBUG [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/WALs/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:26,183 WARN [RS:1;jenkins-hbase4:45889] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:26,183 INFO [RS:1;jenkins-hbase4:45889] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:26,183 DEBUG [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/WALs/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:26,185 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45889,1675861405928] 2023-02-08 13:03:26,185 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32887,1675861405901] 2023-02-08 13:03:26,190 DEBUG [RS:1;jenkins-hbase4:45889] zookeeper.ZKUtil(162): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:26,190 DEBUG [RS:0;jenkins-hbase4:32887] zookeeper.ZKUtil(162): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:26,191 DEBUG [RS:1;jenkins-hbase4:45889] zookeeper.ZKUtil(162): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:26,191 DEBUG [RS:0;jenkins-hbase4:32887] zookeeper.ZKUtil(162): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:26,191 DEBUG [RS:1;jenkins-hbase4:45889] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:03:26,191 DEBUG [RS:0;jenkins-hbase4:32887] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:03:26,191 INFO [RS:1;jenkins-hbase4:45889] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:03:26,191 INFO [RS:0;jenkins-hbase4:32887] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:03:26,192 INFO [RS:1;jenkins-hbase4:45889] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:03:26,193 INFO [RS:1;jenkins-hbase4:45889] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:03:26,193 INFO [RS:1;jenkins-hbase4:45889] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,193 INFO [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:03:26,195 INFO [RS:1;jenkins-hbase4:45889] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,195 INFO [RS:0;jenkins-hbase4:32887] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:03:26,195 DEBUG [RS:1;jenkins-hbase4:45889] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,195 DEBUG [RS:1;jenkins-hbase4:45889] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,195 DEBUG [RS:1;jenkins-hbase4:45889] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,195 INFO [RS:0;jenkins-hbase4:32887] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:03:26,195 DEBUG [RS:1;jenkins-hbase4:45889] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,195 INFO [RS:0;jenkins-hbase4:32887] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,195 DEBUG [RS:1;jenkins-hbase4:45889] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,196 DEBUG [RS:1;jenkins-hbase4:45889] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:26,196 DEBUG [RS:1;jenkins-hbase4:45889] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,196 DEBUG [RS:1;jenkins-hbase4:45889] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,196 DEBUG [RS:1;jenkins-hbase4:45889] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,196 DEBUG [RS:1;jenkins-hbase4:45889] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,200 INFO [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:03:26,201 INFO [RS:1;jenkins-hbase4:45889] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,201 INFO [RS:1;jenkins-hbase4:45889] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,201 INFO [RS:1;jenkins-hbase4:45889] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,202 INFO [RS:0;jenkins-hbase4:32887] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,202 DEBUG [RS:0;jenkins-hbase4:32887] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,202 DEBUG [RS:0;jenkins-hbase4:32887] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,202 DEBUG [RS:0;jenkins-hbase4:32887] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,202 DEBUG [RS:0;jenkins-hbase4:32887] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,203 DEBUG [RS:0;jenkins-hbase4:32887] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,203 DEBUG [RS:0;jenkins-hbase4:32887] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:26,203 DEBUG [RS:0;jenkins-hbase4:32887] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,203 DEBUG [RS:0;jenkins-hbase4:32887] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,203 DEBUG [RS:0;jenkins-hbase4:32887] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,203 DEBUG [RS:0;jenkins-hbase4:32887] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:26,203 INFO [RS:0;jenkins-hbase4:32887] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,204 INFO [RS:0;jenkins-hbase4:32887] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,204 INFO [RS:0;jenkins-hbase4:32887] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,213 INFO [RS:1;jenkins-hbase4:45889] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:03:26,213 INFO [RS:1;jenkins-hbase4:45889] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45889,1675861405928-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,217 INFO [RS:0;jenkins-hbase4:32887] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:03:26,217 INFO [RS:0;jenkins-hbase4:32887] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32887,1675861405901-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,238 INFO [RS:0;jenkins-hbase4:32887] regionserver.Replication(203): jenkins-hbase4.apache.org,32887,1675861405901 started 2023-02-08 13:03:26,238 INFO [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,32887,1675861405901, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32887, sessionid=0x10034079a510001 2023-02-08 13:03:26,238 DEBUG [RS:0;jenkins-hbase4:32887] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:03:26,238 DEBUG [RS:0;jenkins-hbase4:32887] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:26,238 DEBUG [RS:0;jenkins-hbase4:32887] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32887,1675861405901' 2023-02-08 13:03:26,238 DEBUG [RS:0;jenkins-hbase4:32887] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:26,238 DEBUG [RS:0;jenkins-hbase4:32887] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:26,239 DEBUG [RS:0;jenkins-hbase4:32887] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:03:26,239 DEBUG [RS:0;jenkins-hbase4:32887] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:03:26,239 DEBUG [RS:0;jenkins-hbase4:32887] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:26,239 DEBUG [RS:0;jenkins-hbase4:32887] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32887,1675861405901' 2023-02-08 13:03:26,239 DEBUG [RS:0;jenkins-hbase4:32887] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:26,239 DEBUG [RS:0;jenkins-hbase4:32887] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:26,239 DEBUG [RS:0;jenkins-hbase4:32887] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:03:26,239 INFO [RS:0;jenkins-hbase4:32887] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:03:26,239 INFO [RS:0;jenkins-hbase4:32887] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:03:26,243 INFO [RS:1;jenkins-hbase4:45889] regionserver.Replication(203): jenkins-hbase4.apache.org,45889,1675861405928 started 2023-02-08 13:03:26,243 INFO [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45889,1675861405928, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45889, sessionid=0x10034079a510002 2023-02-08 13:03:26,243 DEBUG [RS:1;jenkins-hbase4:45889] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:03:26,243 DEBUG [RS:1;jenkins-hbase4:45889] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:26,243 DEBUG [RS:1;jenkins-hbase4:45889] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45889,1675861405928' 2023-02-08 13:03:26,243 DEBUG [RS:1;jenkins-hbase4:45889] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:26,244 DEBUG [RS:1;jenkins-hbase4:45889] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:26,244 DEBUG [RS:1;jenkins-hbase4:45889] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:03:26,244 DEBUG [RS:1;jenkins-hbase4:45889] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:03:26,244 DEBUG [RS:1;jenkins-hbase4:45889] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:26,244 DEBUG [RS:1;jenkins-hbase4:45889] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45889,1675861405928' 2023-02-08 13:03:26,244 DEBUG [RS:1;jenkins-hbase4:45889] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:26,244 DEBUG [RS:1;jenkins-hbase4:45889] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:26,244 DEBUG [RS:1;jenkins-hbase4:45889] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:03:26,244 INFO [RS:1;jenkins-hbase4:45889] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:03:26,244 INFO [RS:1;jenkins-hbase4:45889] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:03:26,266 DEBUG [jenkins-hbase4:38399] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 13:03:26,266 DEBUG [jenkins-hbase4:38399] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:26,267 DEBUG [jenkins-hbase4:38399] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:26,267 DEBUG [jenkins-hbase4:38399] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:26,267 DEBUG [jenkins-hbase4:38399] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:26,267 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45889,1675861405928, state=OPENING 2023-02-08 13:03:26,268 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 13:03:26,269 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:26,270 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:03:26,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45889,1675861405928}] 2023-02-08 13:03:26,278 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-08 13:03:26,426 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:26,426 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 13:03:26,427 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54500, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 13:03:26,431 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 13:03:26,431 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:26,432 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45889%2C1675861405928.meta, suffix=.meta, logDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/WALs/jenkins-hbase4.apache.org,45889,1675861405928, archiveDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/oldWALs, maxLogs=32 2023-02-08 13:03:26,445 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42843,DS-ee71b14c-7387-473b-b780-eb3503a6afbb,DISK] 2023-02-08 13:03:26,445 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42021,DS-8acd85d6-733d-4c55-9fb6-562968dc1287,DISK] 2023-02-08 13:03:26,446 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/WALs/jenkins-hbase4.apache.org,45889,1675861405928/jenkins-hbase4.apache.org%2C45889%2C1675861405928.meta.1675861406432.meta 2023-02-08 13:03:26,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42843,DS-ee71b14c-7387-473b-b780-eb3503a6afbb,DISK], DatanodeInfoWithStorage[127.0.0.1:42021,DS-8acd85d6-733d-4c55-9fb6-562968dc1287,DISK]] 2023-02-08 13:03:26,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:26,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 13:03:26,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 13:03:26,447 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 13:03:26,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 13:03:26,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:26,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 13:03:26,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 13:03:26,448 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:03:26,449 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/info 2023-02-08 13:03:26,449 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/info 2023-02-08 13:03:26,449 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:03:26,450 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:26,450 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:03:26,450 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:26,450 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:26,451 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:03:26,451 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:26,451 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:03:26,452 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/table 2023-02-08 13:03:26,452 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/table 2023-02-08 13:03:26,452 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:03:26,452 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:26,453 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740 2023-02-08 13:03:26,453 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740 2023-02-08 13:03:26,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:03:26,456 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:03:26,456 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65782178, jitterRate=-0.01976916193962097}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:03:26,456 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675861406447Writing region info on filesystem at 1675861406447Initializing all the Stores at 1675861406448 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861406448Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861406448Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861406448Cleaning up temporary data from old regions at 1675861406454 (+6 ms)Cleaning up detritus from prior splits at 1675861406454Running coprocessor post-open hooks at 1675861406456 (+2 ms)Region opened successfully at 1675861406456 2023-02-08 13:03:26,457 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675861406426 2023-02-08 13:03:26,460 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 13:03:26,461 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 13:03:26,461 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45889,1675861405928, state=OPEN 2023-02-08 13:03:26,463 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 13:03:26,463 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:03:26,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 13:03:26,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45889,1675861405928 in 193 msec 2023-02-08 13:03:26,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 13:03:26,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-08 13:03:26,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 390 msec 2023-02-08 13:03:26,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675861405952, completionTime=-1 2023-02-08 13:03:26,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 13:03:26,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 13:03:26,469 DEBUG [hconnection-0x50dbe9c8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:26,471 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54516, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:26,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 13:03:26,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675861466472 2023-02-08 13:03:26,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675861526472 2023-02-08 13:03:26,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-08 13:03:26,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38399,1675861405855-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38399,1675861405855-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38399,1675861405855-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38399, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:26,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 13:03:26,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:26,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 13:03:26,481 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 13:03:26,481 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:03:26,482 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:03:26,483 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/hbase/namespace/0ccab3f34fda3f9a400de1f53258d04e 2023-02-08 13:03:26,484 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/hbase/namespace/0ccab3f34fda3f9a400de1f53258d04e empty. 2023-02-08 13:03:26,484 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/hbase/namespace/0ccab3f34fda3f9a400de1f53258d04e 2023-02-08 13:03:26,484 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 13:03:26,494 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:26,496 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0ccab3f34fda3f9a400de1f53258d04e, NAME => 'hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp 2023-02-08 13:03:26,504 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:26,504 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 0ccab3f34fda3f9a400de1f53258d04e, disabling compactions & flushes 2023-02-08 13:03:26,504 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. 2023-02-08 13:03:26,504 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. 2023-02-08 13:03:26,504 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. after waiting 0 ms 2023-02-08 13:03:26,504 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. 2023-02-08 13:03:26,504 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. 2023-02-08 13:03:26,504 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 0ccab3f34fda3f9a400de1f53258d04e: Waiting for close lock at 1675861406504Disabling compacts and flushes for region at 1675861406504Disabling writes for close at 1675861406504Writing region close event to WAL at 1675861406504Closed at 1675861406504 2023-02-08 13:03:26,506 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:03:26,507 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861406506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861406506"}]},"ts":"1675861406506"} 2023-02-08 13:03:26,509 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 13:03:26,510 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:03:26,510 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861406510"}]},"ts":"1675861406510"} 2023-02-08 13:03:26,511 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 13:03:26,515 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:26,515 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:26,516 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:26,516 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:26,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0ccab3f34fda3f9a400de1f53258d04e, ASSIGN}] 2023-02-08 13:03:26,518 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0ccab3f34fda3f9a400de1f53258d04e, ASSIGN 2023-02-08 13:03:26,519 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0ccab3f34fda3f9a400de1f53258d04e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32887,1675861405901; forceNewPlan=false, retain=false 2023-02-08 13:03:26,669 INFO [jenkins-hbase4:38399] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 13:03:26,669 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0ccab3f34fda3f9a400de1f53258d04e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:26,669 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861406669"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861406669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861406669"}]},"ts":"1675861406669"} 2023-02-08 13:03:26,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0ccab3f34fda3f9a400de1f53258d04e, server=jenkins-hbase4.apache.org,32887,1675861405901}] 2023-02-08 13:03:26,823 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:26,823 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 13:03:26,825 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46388, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 13:03:26,828 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. 2023-02-08 13:03:26,829 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32887%2C1675861405901, suffix=, logDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/WALs/jenkins-hbase4.apache.org,32887,1675861405901, archiveDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/oldWALs, maxLogs=32 2023-02-08 13:03:26,843 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42021,DS-8acd85d6-733d-4c55-9fb6-562968dc1287,DISK] 2023-02-08 13:03:26,843 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42843,DS-ee71b14c-7387-473b-b780-eb3503a6afbb,DISK] 2023-02-08 13:03:26,844 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/WALs/jenkins-hbase4.apache.org,32887,1675861405901/jenkins-hbase4.apache.org%2C32887%2C1675861405901.1675861406830 2023-02-08 13:03:26,844 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42021,DS-8acd85d6-733d-4c55-9fb6-562968dc1287,DISK], DatanodeInfoWithStorage[127.0.0.1:42843,DS-ee71b14c-7387-473b-b780-eb3503a6afbb,DISK]] 2023-02-08 13:03:26,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0ccab3f34fda3f9a400de1f53258d04e, NAME => 'hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:26,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0ccab3f34fda3f9a400de1f53258d04e 2023-02-08 13:03:26,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:26,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0ccab3f34fda3f9a400de1f53258d04e 2023-02-08 13:03:26,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0ccab3f34fda3f9a400de1f53258d04e 2023-02-08 13:03:26,846 INFO [StoreOpener-0ccab3f34fda3f9a400de1f53258d04e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0ccab3f34fda3f9a400de1f53258d04e 2023-02-08 13:03:26,847 DEBUG [StoreOpener-0ccab3f34fda3f9a400de1f53258d04e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/namespace/0ccab3f34fda3f9a400de1f53258d04e/info 2023-02-08 13:03:26,847 DEBUG [StoreOpener-0ccab3f34fda3f9a400de1f53258d04e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/namespace/0ccab3f34fda3f9a400de1f53258d04e/info 2023-02-08 13:03:26,848 INFO [StoreOpener-0ccab3f34fda3f9a400de1f53258d04e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ccab3f34fda3f9a400de1f53258d04e columnFamilyName info 2023-02-08 13:03:26,848 INFO [StoreOpener-0ccab3f34fda3f9a400de1f53258d04e-1] regionserver.HStore(310): Store=0ccab3f34fda3f9a400de1f53258d04e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:26,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/namespace/0ccab3f34fda3f9a400de1f53258d04e 2023-02-08 13:03:26,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/namespace/0ccab3f34fda3f9a400de1f53258d04e 2023-02-08 13:03:26,850 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0ccab3f34fda3f9a400de1f53258d04e 2023-02-08 13:03:26,852 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/namespace/0ccab3f34fda3f9a400de1f53258d04e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:26,852 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0ccab3f34fda3f9a400de1f53258d04e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69456386, jitterRate=0.03498080372810364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:03:26,852 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0ccab3f34fda3f9a400de1f53258d04e: Running coprocessor pre-open hook at 1675861406845Writing region info on filesystem at 1675861406845Initializing all the Stores at 1675861406846 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861406846Cleaning up temporary data from old regions at 1675861406849 (+3 ms)Cleaning up detritus from prior splits at 1675861406849Running coprocessor post-open hooks at 1675861406852 (+3 ms)Region opened successfully at 1675861406852 2023-02-08 13:03:26,853 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e., pid=6, masterSystemTime=1675861406823 2023-02-08 13:03:26,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. 2023-02-08 13:03:26,859 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. 2023-02-08 13:03:26,859 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0ccab3f34fda3f9a400de1f53258d04e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:26,859 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861406859"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861406859"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861406859"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861406859"}]},"ts":"1675861406859"} 2023-02-08 13:03:26,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 13:03:26,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0ccab3f34fda3f9a400de1f53258d04e, server=jenkins-hbase4.apache.org,32887,1675861405901 in 189 msec 2023-02-08 13:03:26,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 13:03:26,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0ccab3f34fda3f9a400de1f53258d04e, ASSIGN in 346 msec 2023-02-08 13:03:26,863 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:03:26,864 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861406864"}]},"ts":"1675861406864"} 2023-02-08 13:03:26,865 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 13:03:26,867 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:03:26,867 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 388 msec 2023-02-08 13:03:26,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 13:03:26,882 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:26,882 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:26,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:26,885 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46398, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:26,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 13:03:26,894 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:26,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-08 13:03:26,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 13:03:26,914 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:26,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-08 13:03:26,923 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 13:03:26,925 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 13:03:26,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.968sec 2023-02-08 13:03:26,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 13:03:26,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 13:03:26,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 13:03:26,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38399,1675861405855-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 13:03:26,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38399,1675861405855-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 13:03:26,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 13:03:26,951 DEBUG [Listener at localhost/37759] zookeeper.ReadOnlyZKClient(139): Connect 0x5e4b8507 to 127.0.0.1:51359 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:26,960 DEBUG [Listener at localhost/37759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ddfa875, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:26,961 DEBUG [hconnection-0x7dac2ad4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:26,962 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54528, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:26,964 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38399,1675861405855 2023-02-08 13:03:26,964 DEBUG [Listener at localhost/37759] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 13:03:26,964 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:26,964 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:26,965 DEBUG [Listener at localhost/37759] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 13:03:26,967 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39168, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 13:03:26,967 INFO [Listener at localhost/37759] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-08 13:03:26,968 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-08 13:03:26,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 13:03:26,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:39168 deadline: 1675861466968, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-08 13:03:26,968 INFO [Listener at localhost/37759] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-08 13:03:26,969 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:26,969 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:26,971 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:26,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 13:03:26,973 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:03:26,973 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-08 13:03:26,973 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:26,973 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:26,973 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:03:26,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:26,974 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312 2023-02-08 13:03:26,975 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312 empty. 2023-02-08 13:03:26,975 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312 2023-02-08 13:03:26,975 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-08 13:03:26,983 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:26,984 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 373519302512a8d342078c1f2d367312, NAME => 'testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp 2023-02-08 13:03:26,989 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:26,989 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 373519302512a8d342078c1f2d367312, disabling compactions & flushes 2023-02-08 13:03:26,989 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:26,989 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:26,989 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. after waiting 0 ms 2023-02-08 13:03:26,989 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:26,989 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:26,989 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 373519302512a8d342078c1f2d367312: Waiting for close lock at 1675861406989Disabling compacts and flushes for region at 1675861406989Disabling writes for close at 1675861406989Writing region close event to WAL at 1675861406989Closed at 1675861406989 2023-02-08 13:03:26,991 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:03:26,992 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675861406992"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861406992"}]},"ts":"1675861406992"} 2023-02-08 13:03:26,993 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 13:03:26,993 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:03:26,993 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861406993"}]},"ts":"1675861406993"} 2023-02-08 13:03:26,994 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-08 13:03:26,997 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:26,998 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:26,998 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:26,998 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:26,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=373519302512a8d342078c1f2d367312, ASSIGN}] 2023-02-08 13:03:27,000 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=373519302512a8d342078c1f2d367312, ASSIGN 2023-02-08 13:03:27,001 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=373519302512a8d342078c1f2d367312, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45889,1675861405928; forceNewPlan=false, retain=false 2023-02-08 13:03:27,074 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:27,074 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:27,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:27,151 INFO [jenkins-hbase4:38399] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 13:03:27,151 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=373519302512a8d342078c1f2d367312, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,151 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675861407151"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861407151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861407151"}]},"ts":"1675861407151"} 2023-02-08 13:03:27,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 373519302512a8d342078c1f2d367312, server=jenkins-hbase4.apache.org,45889,1675861405928}] 2023-02-08 13:03:27,246 INFO [RS:1;jenkins-hbase4:45889] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45889%2C1675861405928, suffix=, logDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/WALs/jenkins-hbase4.apache.org,45889,1675861405928, archiveDir=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/oldWALs, maxLogs=32 2023-02-08 13:03:27,258 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42021,DS-8acd85d6-733d-4c55-9fb6-562968dc1287,DISK] 2023-02-08 13:03:27,258 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42843,DS-ee71b14c-7387-473b-b780-eb3503a6afbb,DISK] 2023-02-08 13:03:27,260 INFO [RS:1;jenkins-hbase4:45889] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/WALs/jenkins-hbase4.apache.org,45889,1675861405928/jenkins-hbase4.apache.org%2C45889%2C1675861405928.1675861407246 2023-02-08 13:03:27,260 DEBUG [RS:1;jenkins-hbase4:45889] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42021,DS-8acd85d6-733d-4c55-9fb6-562968dc1287,DISK], DatanodeInfoWithStorage[127.0.0.1:42843,DS-ee71b14c-7387-473b-b780-eb3503a6afbb,DISK]] 2023-02-08 13:03:27,275 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:27,276 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:27,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:27,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:27,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 373519302512a8d342078c1f2d367312, NAME => 'testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:27,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 373519302512a8d342078c1f2d367312 2023-02-08 13:03:27,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:27,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 373519302512a8d342078c1f2d367312 2023-02-08 13:03:27,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 373519302512a8d342078c1f2d367312 2023-02-08 13:03:27,309 INFO [StoreOpener-373519302512a8d342078c1f2d367312-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 373519302512a8d342078c1f2d367312 2023-02-08 13:03:27,310 DEBUG [StoreOpener-373519302512a8d342078c1f2d367312-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1 2023-02-08 13:03:27,310 DEBUG [StoreOpener-373519302512a8d342078c1f2d367312-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1 2023-02-08 13:03:27,310 INFO [StoreOpener-373519302512a8d342078c1f2d367312-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 373519302512a8d342078c1f2d367312 columnFamilyName f1 2023-02-08 13:03:27,311 INFO [StoreOpener-373519302512a8d342078c1f2d367312-1] regionserver.HStore(310): Store=373519302512a8d342078c1f2d367312/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:27,311 INFO [StoreOpener-373519302512a8d342078c1f2d367312-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 373519302512a8d342078c1f2d367312 2023-02-08 13:03:27,312 DEBUG [StoreOpener-373519302512a8d342078c1f2d367312-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2 2023-02-08 13:03:27,312 DEBUG [StoreOpener-373519302512a8d342078c1f2d367312-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2 2023-02-08 13:03:27,312 INFO [StoreOpener-373519302512a8d342078c1f2d367312-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 373519302512a8d342078c1f2d367312 columnFamilyName f2 2023-02-08 13:03:27,313 INFO [StoreOpener-373519302512a8d342078c1f2d367312-1] regionserver.HStore(310): Store=373519302512a8d342078c1f2d367312/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:27,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312 2023-02-08 13:03:27,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312 2023-02-08 13:03:27,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:27,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 373519302512a8d342078c1f2d367312 2023-02-08 13:03:27,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:27,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 373519302512a8d342078c1f2d367312; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62422675, jitterRate=-0.06982965767383575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:27,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 373519302512a8d342078c1f2d367312: Running coprocessor pre-open hook at 1675861407308Writing region info on filesystem at 1675861407308Initializing all the Stores at 1675861407308Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861407308Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861407308Cleaning up temporary data from old regions at 1675861407314 (+6 ms)Cleaning up detritus from prior splits at 1675861407315 (+1 ms)Running coprocessor post-open hooks at 1675861407318 (+3 ms)Region opened successfully at 1675861407318 2023-02-08 13:03:27,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312., pid=12, masterSystemTime=1675861407304 2023-02-08 13:03:27,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:27,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:27,321 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=373519302512a8d342078c1f2d367312, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,321 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675861407321"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861407321"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861407321"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861407321"}]},"ts":"1675861407321"} 2023-02-08 13:03:27,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-08 13:03:27,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 373519302512a8d342078c1f2d367312, server=jenkins-hbase4.apache.org,45889,1675861405928 in 169 msec 2023-02-08 13:03:27,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-08 13:03:27,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=373519302512a8d342078c1f2d367312, ASSIGN in 325 msec 2023-02-08 13:03:27,325 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:03:27,325 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861407325"}]},"ts":"1675861407325"} 2023-02-08 13:03:27,326 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-08 13:03:27,328 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:03:27,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 357 msec 2023-02-08 13:03:27,577 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:27,577 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:27,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:27,578 INFO [Listener at localhost/37759] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-08 13:03:27,578 DEBUG [Listener at localhost/37759] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-08 13:03:27,579 INFO [Listener at localhost/37759] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:03:27,580 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-08 13:03:27,581 INFO [Listener at localhost/37759] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:03:27,581 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-08 13:03:27,581 INFO [Listener at localhost/37759] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 13:03:27,611 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45889] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:27,694 INFO [Listener at localhost/37759] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 13:03:27,695 INFO [Listener at localhost/37759] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 13:03:27,695 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:27,695 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:27,696 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-08 13:03:27,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675861407696 (current time:1675861407696). 2023-02-08 13:03:27,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 13:03:27,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] zookeeper.ReadOnlyZKClient(139): Connect 0x7769ac85 to 127.0.0.1:51359 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:27,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f06cb4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:27,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:27,701 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54532, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:27,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7769ac85 to 127.0.0.1:51359 2023-02-08 13:03:27,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:27,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 13:03:27,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-08 13:03:27,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-08 13:03:27,705 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-08 13:03:27,706 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675862007706 2023-02-08 13:03:27,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-08 13:03:27,706 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,707 DEBUG [Listener at localhost/37759] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 13:03:27,707 DEBUG [Listener at localhost/37759] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 13:03:27,708 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-08 13:03:27,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-08 13:03:27,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-08 13:03:27,710 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-08 13:03:27,710 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1675862007710 2023-02-08 13:03:27,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,718 INFO [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-08 13:03:27,718 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:27,718 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-08 13:03:27,718 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-08 13:03:27,719 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,719 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,721 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:27,721 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:27,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:27,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:27,721 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,721 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,721 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:03:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-08 13:03:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-08 13:03:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,722 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-08 13:03:27,722 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-08 13:03:27,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,722 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-08 13:03:27,722 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:27,723 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-08 13:03:27,723 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:27,723 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-08 13:03:27,724 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-08 13:03:27,724 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-08 13:03:27,724 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-08 13:03:27,724 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45889,1675861405928' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-08 13:03:27,724 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32887,1675861405901' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-08 13:03:27,725 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,725 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:27,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:27,726 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,726 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,726 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:27,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:27,726 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,727 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:27,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45889,1675861405928' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-08 13:03:27,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b55ae6[Count = 0] remaining members to acquire global barrier 2023-02-08 13:03:27,728 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-08 13:03:27,728 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,729 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,729 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,729 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-08 13:03:27,729 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-08 13:03:27,729 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-08 13:03:27,729 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,729 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:03:27,729 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,32887,1675861405901' in zk 2023-02-08 13:03:27,729 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-08 13:03:27,729 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 13:03:27,729 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:27,730 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. started... 2023-02-08 13:03:27,730 INFO [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 373519302512a8d342078c1f2d367312 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-08 13:03:27,731 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-08 13:03:27,731 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:27,731 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-08 13:03:27,744 INFO [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/.tmp/f1/42a88927b3dd422f88ea08a5ceefb0ef 2023-02-08 13:03:27,762 INFO [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/.tmp/f2/90deaea42c7646d3a2f00ffeb1e1262e 2023-02-08 13:03:27,765 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/.tmp/f1/42a88927b3dd422f88ea08a5ceefb0ef as hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1/42a88927b3dd422f88ea08a5ceefb0ef 2023-02-08 13:03:27,769 INFO [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1/42a88927b3dd422f88ea08a5ceefb0ef, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 13:03:27,769 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/.tmp/f2/90deaea42c7646d3a2f00ffeb1e1262e as hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2/90deaea42c7646d3a2f00ffeb1e1262e 2023-02-08 13:03:27,773 INFO [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2/90deaea42c7646d3a2f00ffeb1e1262e, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 13:03:27,774 INFO [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 373519302512a8d342078c1f2d367312 in 44ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:27,774 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-08 13:03:27,774 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 373519302512a8d342078c1f2d367312: 2023-02-08 13:03:27,774 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,774 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:27,774 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1/42a88927b3dd422f88ea08a5ceefb0ef] hfiles 2023-02-08 13:03:27,774 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1/42a88927b3dd422f88ea08a5ceefb0ef for snapshot=testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,774 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2/90deaea42c7646d3a2f00ffeb1e1262e] hfiles 2023-02-08 13:03:27,774 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2/90deaea42c7646d3a2f00ffeb1e1262e for snapshot=testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,779 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. completed. 2023-02-08 13:03:27,779 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:27,779 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-08 13:03:27,779 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-08 13:03:27,779 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,780 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-08 13:03:27,780 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,45889,1675861405928' in zk 2023-02-08 13:03:27,781 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-08 13:03:27,781 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,781 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:27,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:27,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:27,781 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-08 13:03:27,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:27,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:27,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:27,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:27,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:27,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,45889,1675861405928': 2023-02-08 13:03:27,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45889,1675861405928' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-08 13:03:27,784 INFO [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-08 13:03:27,784 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:03:27,784 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:03:27,784 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,784 INFO [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 13:03:27,785 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,786 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:27,785 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,786 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,786 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:27,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:27,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:27,786 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,787 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:27,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:27,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,788 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:27,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:27,788 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:27,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,794 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:27,794 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:27,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:27,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:27,794 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:27,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:27,794 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:27,794 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:27,794 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,794 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:27,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:27,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:27,795 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,795 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:27,795 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,795 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:27,795 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,795 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:27,795 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,795 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:27,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:27,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,808 DEBUG [Listener at localhost/37759] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:27,808 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:27,809 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:27,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-08 13:03:27,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:03:27,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,810 DEBUG [Listener at localhost/37759] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 13:03:27,823 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-08 13:03:27,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,823 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:27,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1675861407706Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1675861407795 (+89 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1675861407795Writing data manifest for testWithMockedMapReduceSingleRegion at 1675861407797 (+2 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1675861407803 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1675861407823 (+20 ms) 2023-02-08 13:03:27,825 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-08 13:03:27,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 118 msec 2023-02-08 13:03:28,010 DEBUG [Listener at localhost/37759] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:28,010 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:28,010 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:28,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-08 13:03:28,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 13:03:28,012 INFO [Listener at localhost/37759] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 13:03:28,012 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:28,012 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:28,016 INFO [Listener at localhost/37759] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 13:03:28,020 INFO [Listener at localhost/37759] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 13:03:28,046 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45889] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,126 INFO [Listener at localhost/37759] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 13:03:28,129 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:28,129 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:28,131 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 13:03:28,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,133 INFO [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-08 13:03:28,133 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:28,134 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-08 13:03:28,134 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-08 13:03:28,134 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,134 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,136 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,136 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:28,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:28,136 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:28,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:28,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:28,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:28,136 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,136 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:03:28,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:03:28,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:03:28,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,137 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,137 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,137 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,137 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,137 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-08 13:03:28,137 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:28,137 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-08 13:03:28,138 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-08 13:03:28,138 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-08 13:03:28,138 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32887,1675861405901' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-08 13:03:28,138 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:28,139 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-08 13:03:28,139 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 13:03:28,139 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 13:03:28,140 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,140 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. started... 2023-02-08 13:03:28,140 INFO [rs(jenkins-hbase4.apache.org,45889,1675861405928)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 373519302512a8d342078c1f2d367312 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-08 13:03:28,140 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,141 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,141 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:28,156 INFO [rs(jenkins-hbase4.apache.org,45889,1675861405928)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/.tmp/f1/d38eb65d59a2478c9265163ebc5a965a 2023-02-08 13:03:28,175 INFO [rs(jenkins-hbase4.apache.org,45889,1675861405928)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/.tmp/f2/33767e3d698d472e823be5d02e31a4b0 2023-02-08 13:03:28,179 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/.tmp/f1/d38eb65d59a2478c9265163ebc5a965a as hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1/d38eb65d59a2478c9265163ebc5a965a 2023-02-08 13:03:28,183 INFO [rs(jenkins-hbase4.apache.org,45889,1675861405928)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1/d38eb65d59a2478c9265163ebc5a965a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 13:03:28,183 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/.tmp/f2/33767e3d698d472e823be5d02e31a4b0 as hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2/33767e3d698d472e823be5d02e31a4b0 2023-02-08 13:03:28,187 INFO [rs(jenkins-hbase4.apache.org,45889,1675861405928)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2/33767e3d698d472e823be5d02e31a4b0, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 13:03:28,188 INFO [rs(jenkins-hbase4.apache.org,45889,1675861405928)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 373519302512a8d342078c1f2d367312 in 48ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:28,189 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 373519302512a8d342078c1f2d367312: 2023-02-08 13:03:28,189 DEBUG [rs(jenkins-hbase4.apache.org,45889,1675861405928)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,189 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 13:03:28,190 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 13:03:28,190 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,190 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-08 13:03:28,190 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45889,1675861405928' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-08 13:03:28,191 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,191 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:28,191 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:28,191 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:28,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:28,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:28,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:28,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45889,1675861405928' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-08 13:03:28,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@628ad2e8[Count = 0] remaining members to acquire global barrier 2023-02-08 13:03:28,193 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-08 13:03:28,193 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,195 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,195 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,195 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,195 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:03:28,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,195 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-08 13:03:28,195 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-08 13:03:28,195 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-08 13:03:28,195 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-08 13:03:28,195 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,32887,1675861405901' in zk 2023-02-08 13:03:28,195 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,45889,1675861405928' in zk 2023-02-08 13:03:28,197 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,197 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-08 13:03:28,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:28,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:28,197 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:28,197 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-08 13:03:28,197 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:28,197 DEBUG [member: 'jenkins-hbase4.apache.org,32887,1675861405901' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-08 13:03:28,197 DEBUG [member: 'jenkins-hbase4.apache.org,45889,1675861405928' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-08 13:03:28,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:28,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:28,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:28,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:28,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:28,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,45889,1675861405928': 2023-02-08 13:03:28,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45889,1675861405928' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-08 13:03:28,199 INFO [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-08 13:03:28,199 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:03:28,199 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:03:28,200 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,200 INFO [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 13:03:28,201 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,201 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,201 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:28,201 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:28,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:28,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,201 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:28,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:28,202 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:28,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:28,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,202 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:28,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:28,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,203 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:28,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:28,204 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:28,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,206 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,206 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:28,206 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:28,206 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:28,206 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-08 13:03:28,206 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:28,206 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:28,206 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 13:03:28,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:28,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:28,206 DEBUG [(jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:28,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:28,206 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:28,207 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,207 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,207 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,207 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:28,207 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,207 DEBUG [Listener at localhost/37759] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-08 13:03:28,207 DEBUG [Listener at localhost/37759] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 13:03:28,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:28,207 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:28,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:28,307 DEBUG [Listener at localhost/37759] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 13:03:28,307 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:28,307 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:28,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 13:03:28,313 INFO [Listener at localhost/37759] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675861407696 type: FLUSH version: 2 ttl: 0 2023-02-08 13:03:28,313 DEBUG [Listener at localhost/37759] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34847/user/jenkins/test-data/2211e2a5-05ea-e373-23d9-eb318a6a6ea8/testWithMockedMapReduceSingleRegion/75037320-eda9-48ba-bada-0352b06d61f3/data/default/testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,314 INFO [Listener at localhost/37759] snapshot.RestoreSnapshotHelper(239): region to add: 373519302512a8d342078c1f2d367312 2023-02-08 13:03:28,314 INFO [Listener at localhost/37759] snapshot.RestoreSnapshotHelper(585): clone region=373519302512a8d342078c1f2d367312 as 373519302512a8d342078c1f2d367312 in snapshot testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,314 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 373519302512a8d342078c1f2d367312, NAME => 'testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34847/user/jenkins/test-data/2211e2a5-05ea-e373-23d9-eb318a6a6ea8/testWithMockedMapReduceSingleRegion/75037320-eda9-48ba-bada-0352b06d61f3 2023-02-08 13:03:28,320 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:28,320 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 42a88927b3dd422f88ea08a5ceefb0ef from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,322 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 90deaea42c7646d3a2f00ffeb1e1262e from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,324 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 373519302512a8d342078c1f2d367312, disabling compactions & flushes 2023-02-08 13:03:28,324 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,324 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,324 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. after waiting 0 ms 2023-02-08 13:03:28,324 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,324 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,324 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 373519302512a8d342078c1f2d367312: Waiting for close lock at 1675861408324Disabling compacts and flushes for region at 1675861408324Disabling writes for close at 1675861408324Writing region close event to WAL at 1675861408324Closed at 1675861408324 2023-02-08 13:03:28,324 INFO [Listener at localhost/37759] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675861407696 type: FLUSH version: 2 ttl: 0 2023-02-08 13:03:28,324 DEBUG [Listener at localhost/37759] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34847/user/jenkins/test-data/2211e2a5-05ea-e373-23d9-eb318a6a6ea8/testWithMockedMapReduceSingleRegion/75037320-eda9-48ba-bada-0352b06d61f3 2023-02-08 13:03:28,324 DEBUG [Listener at localhost/37759] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34847/user/jenkins/test-data/2211e2a5-05ea-e373-23d9-eb318a6a6ea8/testWithMockedMapReduceSingleRegion/75037320-eda9-48ba-bada-0352b06d61f3 2023-02-08 13:03:28,325 DEBUG [Listener at localhost/37759] util.CommonFSUtils(699): |-data/ 2023-02-08 13:03:28,325 DEBUG [Listener at localhost/37759] util.CommonFSUtils(699): |----default/ 2023-02-08 13:03:28,325 DEBUG [Listener at localhost/37759] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-08 13:03:28,326 DEBUG [Listener at localhost/37759] util.CommonFSUtils(699): |----------373519302512a8d342078c1f2d367312/ 2023-02-08 13:03:28,326 DEBUG [Listener at localhost/37759] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:28,326 DEBUG [Listener at localhost/37759] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:28,326 DEBUG [Listener at localhost/37759] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=373519302512a8d342078c1f2d367312-42a88927b3dd422f88ea08a5ceefb0ef 2023-02-08 13:03:28,327 DEBUG [Listener at localhost/37759] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:28,327 DEBUG [Listener at localhost/37759] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=373519302512a8d342078c1f2d367312-90deaea42c7646d3a2f00ffeb1e1262e 2023-02-08 13:03:28,329 INFO [Listener at localhost/37759] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-08 13:03:28,333 DEBUG [Listener at localhost/37759] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:28,333 INFO [Listener at localhost/37759] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:28,334 DEBUG [Listener at localhost/37759] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:28,336 INFO [StoreOpener-373519302512a8d342078c1f2d367312-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 373519302512a8d342078c1f2d367312 2023-02-08 13:03:28,337 DEBUG [StoreOpener-373519302512a8d342078c1f2d367312-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/2211e2a5-05ea-e373-23d9-eb318a6a6ea8/testWithMockedMapReduceSingleRegion/75037320-eda9-48ba-bada-0352b06d61f3/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1 2023-02-08 13:03:28,337 INFO [StoreOpener-373519302512a8d342078c1f2d367312-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 373519302512a8d342078c1f2d367312 columnFamilyName f1 2023-02-08 13:03:28,341 DEBUG [StoreOpener-373519302512a8d342078c1f2d367312-1] regionserver.HStore(539): loaded hdfs://localhost:34847/user/jenkins/test-data/2211e2a5-05ea-e373-23d9-eb318a6a6ea8/testWithMockedMapReduceSingleRegion/75037320-eda9-48ba-bada-0352b06d61f3/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1/testWithMockedMapReduceSingleRegion=373519302512a8d342078c1f2d367312-42a88927b3dd422f88ea08a5ceefb0ef 2023-02-08 13:03:28,341 INFO [StoreOpener-373519302512a8d342078c1f2d367312-1] regionserver.HStore(310): Store=373519302512a8d342078c1f2d367312/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:28,341 INFO [StoreOpener-373519302512a8d342078c1f2d367312-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 373519302512a8d342078c1f2d367312 2023-02-08 13:03:28,342 DEBUG [StoreOpener-373519302512a8d342078c1f2d367312-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34847/user/jenkins/test-data/2211e2a5-05ea-e373-23d9-eb318a6a6ea8/testWithMockedMapReduceSingleRegion/75037320-eda9-48ba-bada-0352b06d61f3/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2 2023-02-08 13:03:28,342 INFO [StoreOpener-373519302512a8d342078c1f2d367312-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 373519302512a8d342078c1f2d367312 columnFamilyName f2 2023-02-08 13:03:28,345 DEBUG [StoreOpener-373519302512a8d342078c1f2d367312-1] regionserver.HStore(539): loaded hdfs://localhost:34847/user/jenkins/test-data/2211e2a5-05ea-e373-23d9-eb318a6a6ea8/testWithMockedMapReduceSingleRegion/75037320-eda9-48ba-bada-0352b06d61f3/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2/testWithMockedMapReduceSingleRegion=373519302512a8d342078c1f2d367312-90deaea42c7646d3a2f00ffeb1e1262e 2023-02-08 13:03:28,345 INFO [StoreOpener-373519302512a8d342078c1f2d367312-1] regionserver.HStore(310): Store=373519302512a8d342078c1f2d367312/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:28,345 DEBUG [Listener at localhost/37759] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:28,346 INFO [Listener at localhost/37759] regionserver.HRegion(1071): Opened 373519302512a8d342078c1f2d367312; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70607565, jitterRate=0.05213470757007599}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:28,346 DEBUG [Listener at localhost/37759] regionserver.HRegion(964): Region open journal for 373519302512a8d342078c1f2d367312: Writing region info on filesystem at 1675861408334Initializing all the Stores at 1675861408335 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861408335Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861408335Region opened successfully at 1675861408346 (+11 ms) 2023-02-08 13:03:28,392 DEBUG [Listener at localhost/37759] regionserver.HRegion(1603): Closing 373519302512a8d342078c1f2d367312, disabling compactions & flushes 2023-02-08 13:03:28,392 INFO [Listener at localhost/37759] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,392 DEBUG [Listener at localhost/37759] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,392 DEBUG [Listener at localhost/37759] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. after waiting 0 ms 2023-02-08 13:03:28,392 DEBUG [Listener at localhost/37759] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,393 INFO [Listener at localhost/37759] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,393 DEBUG [Listener at localhost/37759] regionserver.HRegion(1557): Region close journal for 373519302512a8d342078c1f2d367312: Waiting for close lock at 1675861408392Disabling compacts and flushes for region at 1675861408392Disabling writes for close at 1675861408392Writing region close event to WAL at 1675861408393 (+1 ms)Closed at 1675861408393 2023-02-08 13:03:28,395 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:28,396 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:28,397 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-08 13:03:28,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,399 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:28,399 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:28,399 INFO [Listener at localhost/37759] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,400 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,402 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:28,402 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:28,403 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861408403"}]},"ts":"1675861408403"} 2023-02-08 13:03:28,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 13:03:28,404 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-08 13:03:28,406 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-08 13:03:28,407 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=373519302512a8d342078c1f2d367312, UNASSIGN}] 2023-02-08 13:03:28,408 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=373519302512a8d342078c1f2d367312, UNASSIGN 2023-02-08 13:03:28,409 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=373519302512a8d342078c1f2d367312, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,409 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675861408409"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861408409"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861408409"}]},"ts":"1675861408409"} 2023-02-08 13:03:28,410 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 373519302512a8d342078c1f2d367312, server=jenkins-hbase4.apache.org,45889,1675861405928}] 2023-02-08 13:03:28,503 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:28,504 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:28,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 13:03:28,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 373519302512a8d342078c1f2d367312 2023-02-08 13:03:28,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 373519302512a8d342078c1f2d367312, disabling compactions & flushes 2023-02-08 13:03:28,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. after waiting 0 ms 2023-02-08 13:03:28,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:28,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312. 2023-02-08 13:03:28,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 373519302512a8d342078c1f2d367312: Waiting for close lock at 1675861408562Running coprocessor pre-close hooks at 1675861408562Disabling compacts and flushes for region at 1675861408562Disabling writes for close at 1675861408562Writing region close event to WAL at 1675861408563 (+1 ms)Running coprocessor post-close hooks at 1675861408567 (+4 ms)Closed at 1675861408567 2023-02-08 13:03:28,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 373519302512a8d342078c1f2d367312 2023-02-08 13:03:28,568 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=373519302512a8d342078c1f2d367312, regionState=CLOSED 2023-02-08 13:03:28,569 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675861408568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861408568"}]},"ts":"1675861408568"} 2023-02-08 13:03:28,571 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-08 13:03:28,571 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 373519302512a8d342078c1f2d367312, server=jenkins-hbase4.apache.org,45889,1675861405928 in 160 msec 2023-02-08 13:03:28,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-08 13:03:28,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=373519302512a8d342078c1f2d367312, UNASSIGN in 164 msec 2023-02-08 13:03:28,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861408573"}]},"ts":"1675861408573"} 2023-02-08 13:03:28,574 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-08 13:03:28,575 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-08 13:03:28,576 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 176 msec 2023-02-08 13:03:28,705 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:28,705 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:28,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 13:03:28,706 INFO [Listener at localhost/37759] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-08 13:03:28,706 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:28,706 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:28,707 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,709 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,710 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:28,710 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:28,710 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 13:03:28,713 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312 2023-02-08 13:03:28,714 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1, FileablePath, hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2, FileablePath, hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/recovered.edits] 2023-02-08 13:03:28,717 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1/42a88927b3dd422f88ea08a5ceefb0ef to hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/archive/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1/42a88927b3dd422f88ea08a5ceefb0ef 2023-02-08 13:03:28,718 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1/d38eb65d59a2478c9265163ebc5a965a to hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/archive/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f1/d38eb65d59a2478c9265163ebc5a965a 2023-02-08 13:03:28,721 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2/33767e3d698d472e823be5d02e31a4b0 to hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/archive/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2/33767e3d698d472e823be5d02e31a4b0 2023-02-08 13:03:28,722 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2/90deaea42c7646d3a2f00ffeb1e1262e to hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/archive/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/f2/90deaea42c7646d3a2f00ffeb1e1262e 2023-02-08 13:03:28,724 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/recovered.edits/12.seqid to hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/archive/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312/recovered.edits/12.seqid 2023-02-08 13:03:28,724 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/.tmp/data/default/testWithMockedMapReduceSingleRegion/373519302512a8d342078c1f2d367312 2023-02-08 13:03:28,724 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-08 13:03:28,726 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,727 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-08 13:03:28,729 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-08 13:03:28,729 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,729 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-08 13:03:28,730 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861408730"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:28,731 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-08 13:03:28,731 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 373519302512a8d342078c1f2d367312, NAME => 'testWithMockedMapReduceSingleRegion,,1675861406970.373519302512a8d342078c1f2d367312.', STARTKEY => '', ENDKEY => ''}] 2023-02-08 13:03:28,731 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-08 13:03:28,731 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675861408731"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:28,732 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-08 13:03:28,733 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-08 13:03:28,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 26 msec 2023-02-08 13:03:28,811 INFO [Listener at localhost/37759] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:28,811 INFO [Listener at localhost/37759] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:28,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38399] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 13:03:28,812 INFO [Listener at localhost/37759] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-08 13:03:28,812 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 13:03:28,813 INFO [Listener at localhost/37759] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 13:03:28,813 DEBUG [Listener at localhost/37759] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e4b8507 to 127.0.0.1:51359 2023-02-08 13:03:28,813 DEBUG [Listener at localhost/37759] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:28,813 DEBUG [Listener at localhost/37759] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 13:03:28,813 DEBUG [Listener at localhost/37759] util.JVMClusterUtil(257): Found active master hash=1730650268, stopped=false 2023-02-08 13:03:28,813 INFO [Listener at localhost/37759] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38399,1675861405855 2023-02-08 13:03:28,816 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:28,816 INFO [Listener at localhost/37759] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 13:03:28,816 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:28,816 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:28,816 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:28,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:28,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:28,818 DEBUG [Listener at localhost/37759] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x509c2bfc to 127.0.0.1:51359 2023-02-08 13:03:28,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:28,818 DEBUG [Listener at localhost/37759] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:28,818 INFO [Listener at localhost/37759] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,32887,1675861405901' ***** 2023-02-08 13:03:28,818 INFO [Listener at localhost/37759] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:28,818 INFO [Listener at localhost/37759] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45889,1675861405928' ***** 2023-02-08 13:03:28,818 INFO [Listener at localhost/37759] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:28,818 INFO [RS:0;jenkins-hbase4:32887] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:28,819 INFO [RS:0;jenkins-hbase4:32887] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:28,819 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:28,819 INFO [RS:0;jenkins-hbase4:32887] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:28,819 INFO [RS:1;jenkins-hbase4:45889] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:28,819 INFO [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(3304): Received CLOSE for 0ccab3f34fda3f9a400de1f53258d04e 2023-02-08 13:03:28,820 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:28,820 INFO [RS:1;jenkins-hbase4:45889] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:28,821 INFO [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:28,821 INFO [RS:1;jenkins-hbase4:45889] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:28,821 DEBUG [RS:0;jenkins-hbase4:32887] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a3c8fdf to 127.0.0.1:51359 2023-02-08 13:03:28,821 INFO [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:28,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0ccab3f34fda3f9a400de1f53258d04e, disabling compactions & flushes 2023-02-08 13:03:28,821 DEBUG [RS:1;jenkins-hbase4:45889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06e42e63 to 127.0.0.1:51359 2023-02-08 13:03:28,821 DEBUG [RS:1;jenkins-hbase4:45889] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:28,821 INFO [RS:1;jenkins-hbase4:45889] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:28,821 INFO [RS:1;jenkins-hbase4:45889] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:28,821 INFO [RS:1;jenkins-hbase4:45889] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:28,821 INFO [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 13:03:28,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. 2023-02-08 13:03:28,821 DEBUG [RS:0;jenkins-hbase4:32887] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:28,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. 2023-02-08 13:03:28,821 INFO [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 13:03:28,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. after waiting 0 ms 2023-02-08 13:03:28,821 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:03:28,821 INFO [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 13:03:28,822 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:03:28,822 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:03:28,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. 2023-02-08 13:03:28,822 DEBUG [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-08 13:03:28,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 0ccab3f34fda3f9a400de1f53258d04e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 13:03:28,822 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:03:28,822 DEBUG [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(1479): Online Regions={0ccab3f34fda3f9a400de1f53258d04e=hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e.} 2023-02-08 13:03:28,822 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:03:28,822 DEBUG [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(1505): Waiting on 0ccab3f34fda3f9a400de1f53258d04e 2023-02-08 13:03:28,822 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-08 13:03:28,822 DEBUG [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 13:03:28,830 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/.tmp/info/2dbd6013e0d348568165891ad8c0c982 2023-02-08 13:03:28,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/namespace/0ccab3f34fda3f9a400de1f53258d04e/.tmp/info/d387d3123d174eff9c309b81c4cb40e2 2023-02-08 13:03:28,834 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dbd6013e0d348568165891ad8c0c982 2023-02-08 13:03:28,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/namespace/0ccab3f34fda3f9a400de1f53258d04e/.tmp/info/d387d3123d174eff9c309b81c4cb40e2 as hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/namespace/0ccab3f34fda3f9a400de1f53258d04e/info/d387d3123d174eff9c309b81c4cb40e2 2023-02-08 13:03:28,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/namespace/0ccab3f34fda3f9a400de1f53258d04e/info/d387d3123d174eff9c309b81c4cb40e2, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 13:03:28,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0ccab3f34fda3f9a400de1f53258d04e in 17ms, sequenceid=6, compaction requested=false 2023-02-08 13:03:28,841 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/.tmp/rep_barrier/50b49f4238bc46c395abb2a322b8789d 2023-02-08 13:03:28,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/namespace/0ccab3f34fda3f9a400de1f53258d04e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 13:03:28,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. 2023-02-08 13:03:28,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0ccab3f34fda3f9a400de1f53258d04e: Waiting for close lock at 1675861408821Running coprocessor pre-close hooks at 1675861408821Disabling compacts and flushes for region at 1675861408821Disabling writes for close at 1675861408822 (+1 ms)Obtaining lock to block concurrent updates at 1675861408822Preparing flush snapshotting stores in 0ccab3f34fda3f9a400de1f53258d04e at 1675861408822Finished memstore snapshotting hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675861408822Flushing stores of hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. at 1675861408823 (+1 ms)Flushing 0ccab3f34fda3f9a400de1f53258d04e/info: creating writer at 1675861408823Flushing 0ccab3f34fda3f9a400de1f53258d04e/info: appending metadata at 1675861408825 (+2 ms)Flushing 0ccab3f34fda3f9a400de1f53258d04e/info: closing flushed file at 1675861408825Flushing 0ccab3f34fda3f9a400de1f53258d04e/info: reopening flushed file at 1675861408835 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0ccab3f34fda3f9a400de1f53258d04e in 17ms, sequenceid=6, compaction requested=false at 1675861408839 (+4 ms)Writing region close event to WAL at 1675861408839Running coprocessor post-close hooks at 1675861408842 (+3 ms)Closed at 1675861408842 2023-02-08 13:03:28,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675861406479.0ccab3f34fda3f9a400de1f53258d04e. 2023-02-08 13:03:28,844 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50b49f4238bc46c395abb2a322b8789d 2023-02-08 13:03:28,851 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/.tmp/table/829e0dff3d20446f8d29fb05f75a0497 2023-02-08 13:03:28,854 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 829e0dff3d20446f8d29fb05f75a0497 2023-02-08 13:03:28,855 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/.tmp/info/2dbd6013e0d348568165891ad8c0c982 as hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/info/2dbd6013e0d348568165891ad8c0c982 2023-02-08 13:03:28,858 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dbd6013e0d348568165891ad8c0c982 2023-02-08 13:03:28,859 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/info/2dbd6013e0d348568165891ad8c0c982, entries=12, sequenceid=21, filesize=6.3 K 2023-02-08 13:03:28,859 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/.tmp/rep_barrier/50b49f4238bc46c395abb2a322b8789d as hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/rep_barrier/50b49f4238bc46c395abb2a322b8789d 2023-02-08 13:03:28,862 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50b49f4238bc46c395abb2a322b8789d 2023-02-08 13:03:28,863 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/rep_barrier/50b49f4238bc46c395abb2a322b8789d, entries=1, sequenceid=21, filesize=5.0 K 2023-02-08 13:03:28,863 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/.tmp/table/829e0dff3d20446f8d29fb05f75a0497 as hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/table/829e0dff3d20446f8d29fb05f75a0497 2023-02-08 13:03:28,867 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 829e0dff3d20446f8d29fb05f75a0497 2023-02-08 13:03:28,867 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/table/829e0dff3d20446f8d29fb05f75a0497, entries=4, sequenceid=21, filesize=5.1 K 2023-02-08 13:03:28,870 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 48ms, sequenceid=21, compaction requested=false 2023-02-08 13:03:28,874 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-08 13:03:28,875 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 13:03:28,875 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:28,875 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861408821Running coprocessor pre-close hooks at 1675861408821Disabling compacts and flushes for region at 1675861408821Disabling writes for close at 1675861408822 (+1 ms)Obtaining lock to block concurrent updates at 1675861408822Preparing flush snapshotting stores in 1588230740 at 1675861408822Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1675861408822Flushing stores of hbase:meta,,1.1588230740 at 1675861408823 (+1 ms)Flushing 1588230740/info: creating writer at 1675861408823Flushing 1588230740/info: appending metadata at 1675861408825 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675861408825Flushing 1588230740/rep_barrier: creating writer at 1675861408834 (+9 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675861408836 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675861408836Flushing 1588230740/table: creating writer at 1675861408844 (+8 ms)Flushing 1588230740/table: appending metadata at 1675861408846 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675861408846Flushing 1588230740/info: reopening flushed file at 1675861408855 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675861408859 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675861408864 (+5 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 48ms, sequenceid=21, compaction requested=false at 1675861408870 (+6 ms)Writing region close event to WAL at 1675861408872 (+2 ms)Running coprocessor post-close hooks at 1675861408875 (+3 ms)Closed at 1675861408875 2023-02-08 13:03:28,875 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:28,903 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:28,909 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:29,022 INFO [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,32887,1675861405901; all regions closed. 2023-02-08 13:03:29,022 INFO [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45889,1675861405928; all regions closed. 2023-02-08 13:03:29,026 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/WALs/jenkins-hbase4.apache.org,45889,1675861405928/jenkins-hbase4.apache.org%2C45889%2C1675861405928.meta.1675861406432.meta not finished, retry = 0 2023-02-08 13:03:29,027 DEBUG [RS:0;jenkins-hbase4:32887] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/oldWALs 2023-02-08 13:03:29,027 INFO [RS:0;jenkins-hbase4:32887] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32887%2C1675861405901:(num 1675861406830) 2023-02-08 13:03:29,027 DEBUG [RS:0;jenkins-hbase4:32887] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:29,028 INFO [RS:0;jenkins-hbase4:32887] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:29,028 INFO [RS:0;jenkins-hbase4:32887] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:29,028 INFO [RS:0;jenkins-hbase4:32887] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:29,028 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:29,028 INFO [RS:0;jenkins-hbase4:32887] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:29,028 INFO [RS:0;jenkins-hbase4:32887] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:29,029 INFO [RS:0;jenkins-hbase4:32887] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32887 2023-02-08 13:03:29,031 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:29,031 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32887,1675861405901 2023-02-08 13:03:29,031 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:29,031 ERROR [Listener at localhost/37759-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2774222b rejected from java.util.concurrent.ThreadPoolExecutor@234ba21d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:29,031 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:29,032 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:29,032 ERROR [Listener at localhost/37759-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@51867d15 rejected from java.util.concurrent.ThreadPoolExecutor@234ba21d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:29,032 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32887,1675861405901] 2023-02-08 13:03:29,032 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32887,1675861405901; numProcessing=1 2023-02-08 13:03:29,033 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32887,1675861405901 already deleted, retry=false 2023-02-08 13:03:29,033 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32887,1675861405901 expired; onlineServers=1 2023-02-08 13:03:29,128 DEBUG [RS:1;jenkins-hbase4:45889] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/oldWALs 2023-02-08 13:03:29,128 INFO [RS:1;jenkins-hbase4:45889] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45889%2C1675861405928.meta:.meta(num 1675861406432) 2023-02-08 13:03:29,131 DEBUG [RS:1;jenkins-hbase4:45889] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/oldWALs 2023-02-08 13:03:29,131 INFO [RS:1;jenkins-hbase4:45889] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45889%2C1675861405928:(num 1675861407246) 2023-02-08 13:03:29,131 DEBUG [RS:1;jenkins-hbase4:45889] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:29,131 INFO [RS:1;jenkins-hbase4:45889] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:29,132 INFO [RS:1;jenkins-hbase4:45889] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:29,132 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:29,133 INFO [RS:1;jenkins-hbase4:45889] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45889 2023-02-08 13:03:29,134 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45889,1675861405928 2023-02-08 13:03:29,134 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:29,134 ERROR [Listener at localhost/37759-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@c0f87ff rejected from java.util.concurrent.ThreadPoolExecutor@83012a6[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:29,136 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45889,1675861405928] 2023-02-08 13:03:29,137 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45889,1675861405928; numProcessing=2 2023-02-08 13:03:29,137 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45889,1675861405928 already deleted, retry=false 2023-02-08 13:03:29,138 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45889,1675861405928 expired; onlineServers=0 2023-02-08 13:03:29,138 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38399,1675861405855' ***** 2023-02-08 13:03:29,138 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 13:03:29,138 DEBUG [M:0;jenkins-hbase4:38399] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@631838a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:29,139 INFO [M:0;jenkins-hbase4:38399] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38399,1675861405855 2023-02-08 13:03:29,139 INFO [M:0;jenkins-hbase4:38399] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38399,1675861405855; all regions closed. 2023-02-08 13:03:29,139 DEBUG [M:0;jenkins-hbase4:38399] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:29,139 DEBUG [M:0;jenkins-hbase4:38399] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 13:03:29,139 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 13:03:29,139 DEBUG [M:0;jenkins-hbase4:38399] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 13:03:29,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861406085] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861406085,5,FailOnTimeoutGroup] 2023-02-08 13:03:29,139 INFO [M:0;jenkins-hbase4:38399] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 13:03:29,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861406084] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861406084,5,FailOnTimeoutGroup] 2023-02-08 13:03:29,140 INFO [M:0;jenkins-hbase4:38399] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 13:03:29,140 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:29,140 INFO [M:0;jenkins-hbase4:38399] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 13:03:29,140 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:29,140 DEBUG [M:0;jenkins-hbase4:38399] master.HMaster(1502): Stopping service threads 2023-02-08 13:03:29,140 INFO [M:0;jenkins-hbase4:38399] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 13:03:29,141 ERROR [M:0;jenkins-hbase4:38399] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-08 13:03:29,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:29,141 INFO [M:0;jenkins-hbase4:38399] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 13:03:29,141 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 13:03:29,142 DEBUG [M:0;jenkins-hbase4:38399] zookeeper.ZKUtil(398): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 13:03:29,142 WARN [M:0;jenkins-hbase4:38399] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 13:03:29,142 INFO [M:0;jenkins-hbase4:38399] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 13:03:29,142 INFO [M:0;jenkins-hbase4:38399] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 13:03:29,142 DEBUG [M:0;jenkins-hbase4:38399] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:03:29,143 INFO [M:0;jenkins-hbase4:38399] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:29,143 DEBUG [M:0;jenkins-hbase4:38399] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:29,143 DEBUG [M:0;jenkins-hbase4:38399] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:03:29,143 DEBUG [M:0;jenkins-hbase4:38399] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:29,143 INFO [M:0;jenkins-hbase4:38399] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.12 KB heapSize=67.06 KB 2023-02-08 13:03:29,154 INFO [M:0;jenkins-hbase4:38399] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.12 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/960c1dda80254434934389b026560a90 2023-02-08 13:03:29,157 DEBUG [M:0;jenkins-hbase4:38399] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/960c1dda80254434934389b026560a90 as hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/960c1dda80254434934389b026560a90 2023-02-08 13:03:29,160 INFO [M:0;jenkins-hbase4:38399] regionserver.HStore(1080): Added hdfs://localhost:34847/user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/960c1dda80254434934389b026560a90, entries=17, sequenceid=132, filesize=8.7 K 2023-02-08 13:03:29,161 INFO [M:0;jenkins-hbase4:38399] regionserver.HRegion(2947): Finished flush of dataSize ~56.12 KB/57463, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-08 13:03:29,162 INFO [M:0;jenkins-hbase4:38399] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:29,162 DEBUG [M:0;jenkins-hbase4:38399] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861409142Disabling compacts and flushes for region at 1675861409142Disabling writes for close at 1675861409143 (+1 ms)Obtaining lock to block concurrent updates at 1675861409143Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675861409143Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57463, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1675861409143Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675861409144 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675861409144Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675861409147 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675861409147Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675861409158 (+11 ms)Finished flush of dataSize ~56.12 KB/57463, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1675861409161 (+3 ms)Writing region close event to WAL at 1675861409162 (+1 ms)Closed at 1675861409162 2023-02-08 13:03:29,164 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/9ce90aa9-e65b-b83d-f012-926a21da25d4/MasterData/WALs/jenkins-hbase4.apache.org,38399,1675861405855/jenkins-hbase4.apache.org%2C38399%2C1675861405855.1675861406010 not finished, retry = 0 2023-02-08 13:03:29,265 INFO [M:0;jenkins-hbase4:38399] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 13:03:29,265 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:29,266 INFO [M:0;jenkins-hbase4:38399] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38399 2023-02-08 13:03:29,268 DEBUG [M:0;jenkins-hbase4:38399] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38399,1675861405855 already deleted, retry=false 2023-02-08 13:03:29,317 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:29,317 INFO [RS:1;jenkins-hbase4:45889] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45889,1675861405928; zookeeper connection closed. 2023-02-08 13:03:29,318 ERROR [Listener at localhost/37759-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@c755b7d rejected from java.util.concurrent.ThreadPoolExecutor@83012a6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:29,320 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@fc54320] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@fc54320 2023-02-08 13:03:29,320 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:45889-0x10034079a510002, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:29,320 ERROR [Listener at localhost/37759-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74188d61 rejected from java.util.concurrent.ThreadPoolExecutor@83012a6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:29,418 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:29,418 INFO [RS:0;jenkins-hbase4:32887] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,32887,1675861405901; zookeeper connection closed. 2023-02-08 13:03:29,418 ERROR [Listener at localhost/37759-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@294063cf rejected from java.util.concurrent.ThreadPoolExecutor@234ba21d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:29,418 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): regionserver:32887-0x10034079a510001, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:29,418 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5f296fc4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5f296fc4 2023-02-08 13:03:29,418 ERROR [Listener at localhost/37759-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@646a7c53 rejected from java.util.concurrent.ThreadPoolExecutor@234ba21d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:29,419 INFO [Listener at localhost/37759] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 13:03:29,518 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:29,518 INFO [M:0;jenkins-hbase4:38399] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38399,1675861405855; zookeeper connection closed. 2023-02-08 13:03:29,518 ERROR [Listener at localhost/37759-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@65d6cbe4 rejected from java.util.concurrent.ThreadPoolExecutor@61e94386[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:29,519 DEBUG [Listener at localhost/37759-EventThread] zookeeper.ZKWatcher(600): master:38399-0x10034079a510000, quorum=127.0.0.1:51359, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:29,519 ERROR [Listener at localhost/37759-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@46df0b2c rejected from java.util.concurrent.ThreadPoolExecutor@61e94386[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:29,519 WARN [Listener at localhost/37759] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:29,523 INFO [Listener at localhost/37759] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:29,628 WARN [BP-856619887-172.31.14.131-1675861405171 heartbeating to localhost/127.0.0.1:34847] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:29,629 WARN [BP-856619887-172.31.14.131-1675861405171 heartbeating to localhost/127.0.0.1:34847] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-856619887-172.31.14.131-1675861405171 (Datanode Uuid dd078dba-9a64-4e2e-8649-29bfaa149b40) service to localhost/127.0.0.1:34847 2023-02-08 13:03:29,629 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/cluster_ceb6ad05-198c-9b4f-3bbc-970b0a8b25f2/dfs/data/data3/current/BP-856619887-172.31.14.131-1675861405171] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:29,630 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/cluster_ceb6ad05-198c-9b4f-3bbc-970b0a8b25f2/dfs/data/data4/current/BP-856619887-172.31.14.131-1675861405171] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:29,631 WARN [Listener at localhost/37759] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:29,636 INFO [Listener at localhost/37759] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:29,739 WARN [BP-856619887-172.31.14.131-1675861405171 heartbeating to localhost/127.0.0.1:34847] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:29,739 WARN [BP-856619887-172.31.14.131-1675861405171 heartbeating to localhost/127.0.0.1:34847] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-856619887-172.31.14.131-1675861405171 (Datanode Uuid e1dd6ab2-44a6-4434-b7b8-196ea4ea4845) service to localhost/127.0.0.1:34847 2023-02-08 13:03:29,740 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/cluster_ceb6ad05-198c-9b4f-3bbc-970b0a8b25f2/dfs/data/data1/current/BP-856619887-172.31.14.131-1675861405171] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:29,740 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/cluster_ceb6ad05-198c-9b4f-3bbc-970b0a8b25f2/dfs/data/data2/current/BP-856619887-172.31.14.131-1675861405171] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:29,751 INFO [Listener at localhost/37759] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:29,865 INFO [Listener at localhost/37759] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 13:03:29,883 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 13:03:29,887 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 13:03:29,894 INFO [Listener at localhost/37759] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=251 (was 228) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38399,1675861405855)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37759 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37759.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34847 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34847 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34847 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:34847 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34847 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:34847 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34847 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=664 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=294 (was 293) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=3880 (was 3919) 2023-02-08 13:03:29,904 INFO [Listener at localhost/37759] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=251, OpenFileDescriptor=664, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=165, AvailableMemoryMB=3880 2023-02-08 13:03:29,914 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/hadoop.log.dir so I do NOT create it in target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3 2023-02-08 13:03:29,914 WARN [Listener at localhost/37759] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/hadoop.log.dir Erasing configuration value by system value. 2023-02-08 13:03:29,914 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/hadoop.tmp.dir so I do NOT create it in target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3 2023-02-08 13:03:29,914 WARN [Listener at localhost/37759] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2151448-d346-aa1c-ae4d-f70343c927a5/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-08 13:03:29,915 DEBUG [Listener at localhost/37759] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3 2023-02-08 13:03:29,915 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 13:03:29,915 INFO [Listener at localhost/37759] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/cluster_f5eab605-f986-9221-589c-45475c820bdf, deleteOnExit=true 2023-02-08 13:03:29,915 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 13:03:29,915 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/test.cache.data in system properties and HBase conf 2023-02-08 13:03:29,915 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 13:03:29,915 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/hadoop.log.dir in system properties and HBase conf 2023-02-08 13:03:29,915 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 13:03:29,915 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 13:03:29,915 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 13:03:29,915 DEBUG [Listener at localhost/37759] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 13:03:29,916 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:03:29,916 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:03:29,916 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 13:03:29,916 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:03:29,916 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 13:03:29,916 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 13:03:29,916 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:03:29,916 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:03:29,916 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 13:03:29,916 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/nfs.dump.dir in system properties and HBase conf 2023-02-08 13:03:29,917 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/java.io.tmpdir in system properties and HBase conf 2023-02-08 13:03:29,917 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:03:29,917 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 13:03:29,917 INFO [Listener at localhost/37759] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 13:03:29,948 WARN [Listener at localhost/37759] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:03:29,949 WARN [Listener at localhost/37759] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:03:29,989 WARN [Listener at localhost/37759] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:29,991 INFO [Listener at localhost/37759] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:29,996 INFO [Listener at localhost/37759] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/java.io.tmpdir/Jetty_localhost_36969_hdfs____3fthcz/webapp 2023-02-08 13:03:30,089 INFO [Listener at localhost/37759] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36969 2023-02-08 13:03:30,093 WARN [Listener at localhost/37759] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:03:30,093 WARN [Listener at localhost/37759] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:03:30,133 WARN [Listener at localhost/43357] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:30,147 WARN [Listener at localhost/43357] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:03:30,149 WARN [Listener at localhost/43357] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:30,150 INFO [Listener at localhost/43357] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:30,155 INFO [Listener at localhost/43357] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/java.io.tmpdir/Jetty_localhost_34577_datanode____.auijwl/webapp 2023-02-08 13:03:30,260 INFO [Listener at localhost/43357] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34577 2023-02-08 13:03:30,272 WARN [Listener at localhost/37219] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:30,289 WARN [Listener at localhost/37219] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:03:30,292 WARN [Listener at localhost/37219] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:30,293 INFO [Listener at localhost/37219] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:30,298 INFO [Listener at localhost/37219] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/java.io.tmpdir/Jetty_localhost_45995_datanode____orqswr/webapp 2023-02-08 13:03:30,372 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb56a54bef236073: Processing first storage report for DS-89ae809f-4987-4957-ae8f-195bb4ad8dab from datanode d3eea08b-1e39-468e-b146-6d82c619c200 2023-02-08 13:03:30,373 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb56a54bef236073: from storage DS-89ae809f-4987-4957-ae8f-195bb4ad8dab node DatanodeRegistration(127.0.0.1:44869, datanodeUuid=d3eea08b-1e39-468e-b146-6d82c619c200, infoPort=37921, infoSecurePort=0, ipcPort=37219, storageInfo=lv=-57;cid=testClusterID;nsid=1366632498;c=1675861409952), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-08 13:03:30,373 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb56a54bef236073: Processing first storage report for DS-35567440-436a-4e57-b2f7-dc8940a4bc16 from datanode d3eea08b-1e39-468e-b146-6d82c619c200 2023-02-08 13:03:30,373 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb56a54bef236073: from storage DS-35567440-436a-4e57-b2f7-dc8940a4bc16 node DatanodeRegistration(127.0.0.1:44869, datanodeUuid=d3eea08b-1e39-468e-b146-6d82c619c200, infoPort=37921, infoSecurePort=0, ipcPort=37219, storageInfo=lv=-57;cid=testClusterID;nsid=1366632498;c=1675861409952), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:30,407 INFO [Listener at localhost/37219] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45995 2023-02-08 13:03:30,416 WARN [Listener at localhost/46305] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:30,498 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x17faafd2fe844688: Processing first storage report for DS-5746585f-f8c1-474b-9861-cf1b7cf78db0 from datanode 8b68e206-f049-4706-bac5-8be9c0e66287 2023-02-08 13:03:30,498 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x17faafd2fe844688: from storage DS-5746585f-f8c1-474b-9861-cf1b7cf78db0 node DatanodeRegistration(127.0.0.1:44601, datanodeUuid=8b68e206-f049-4706-bac5-8be9c0e66287, infoPort=36735, infoSecurePort=0, ipcPort=46305, storageInfo=lv=-57;cid=testClusterID;nsid=1366632498;c=1675861409952), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:30,498 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x17faafd2fe844688: Processing first storage report for DS-0ed62ffa-b6ab-4e1d-b21d-ce659c011a2c from datanode 8b68e206-f049-4706-bac5-8be9c0e66287 2023-02-08 13:03:30,498 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x17faafd2fe844688: from storage DS-0ed62ffa-b6ab-4e1d-b21d-ce659c011a2c node DatanodeRegistration(127.0.0.1:44601, datanodeUuid=8b68e206-f049-4706-bac5-8be9c0e66287, infoPort=36735, infoSecurePort=0, ipcPort=46305, storageInfo=lv=-57;cid=testClusterID;nsid=1366632498;c=1675861409952), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:30,521 DEBUG [Listener at localhost/46305] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3 2023-02-08 13:03:30,523 INFO [Listener at localhost/46305] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/cluster_f5eab605-f986-9221-589c-45475c820bdf/zookeeper_0, clientPort=59811, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/cluster_f5eab605-f986-9221-589c-45475c820bdf/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/cluster_f5eab605-f986-9221-589c-45475c820bdf/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 13:03:30,526 INFO [Listener at localhost/46305] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59811 2023-02-08 13:03:30,526 INFO [Listener at localhost/46305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:30,527 INFO [Listener at localhost/46305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:30,544 INFO [Listener at localhost/46305] util.FSUtils(479): Created version file at hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2 with version=8 2023-02-08 13:03:30,545 INFO [Listener at localhost/46305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:30,545 INFO [Listener at localhost/46305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:30,546 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43357/user/jenkins/test-data/938bfda3-3d89-b956-020a-2cdc78499351/hbase-staging 2023-02-08 13:03:30,548 INFO [Listener at localhost/46305] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:30,548 INFO [Listener at localhost/46305] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:30,548 INFO [Listener at localhost/46305] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:30,548 INFO [Listener at localhost/46305] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:30,549 INFO [Listener at localhost/46305] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:30,549 INFO [Listener at localhost/46305] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:30,549 INFO [Listener at localhost/46305] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:30,551 INFO [Listener at localhost/46305] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37177 2023-02-08 13:03:30,552 INFO [Listener at localhost/46305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:30,552 INFO [Listener at localhost/46305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:30,553 INFO [Listener at localhost/46305] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37177 connecting to ZooKeeper ensemble=127.0.0.1:59811 2023-02-08 13:03:30,565 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:371770x0, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:30,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37177-0x1003407aca00000 connected 2023-02-08 13:03:30,585 DEBUG [Listener at localhost/46305] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:30,586 DEBUG [Listener at localhost/46305] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:30,586 DEBUG [Listener at localhost/46305] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:30,587 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37177 2023-02-08 13:03:30,587 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37177 2023-02-08 13:03:30,588 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37177 2023-02-08 13:03:30,590 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37177 2023-02-08 13:03:30,590 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37177 2023-02-08 13:03:30,590 INFO [Listener at localhost/46305] master.HMaster(439): hbase.rootdir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2, hbase.cluster.distributed=false 2023-02-08 13:03:30,602 INFO [Listener at localhost/46305] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:30,603 INFO [Listener at localhost/46305] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:30,603 INFO [Listener at localhost/46305] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:30,603 INFO [Listener at localhost/46305] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:30,603 INFO [Listener at localhost/46305] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:30,603 INFO [Listener at localhost/46305] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:30,603 INFO [Listener at localhost/46305] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:30,604 INFO [Listener at localhost/46305] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35459 2023-02-08 13:03:30,604 INFO [Listener at localhost/46305] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:03:30,607 DEBUG [Listener at localhost/46305] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:30,608 INFO [Listener at localhost/46305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:30,609 INFO [Listener at localhost/46305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:30,610 INFO [Listener at localhost/46305] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35459 connecting to ZooKeeper ensemble=127.0.0.1:59811 2023-02-08 13:03:30,612 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:354590x0, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:30,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35459-0x1003407aca00001 connected 2023-02-08 13:03:30,614 DEBUG [Listener at localhost/46305] zookeeper.ZKUtil(164): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:30,614 DEBUG [Listener at localhost/46305] zookeeper.ZKUtil(164): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:30,615 DEBUG [Listener at localhost/46305] zookeeper.ZKUtil(164): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:30,615 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35459 2023-02-08 13:03:30,616 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35459 2023-02-08 13:03:30,617 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35459 2023-02-08 13:03:30,620 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35459 2023-02-08 13:03:30,624 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35459 2023-02-08 13:03:30,634 INFO [Listener at localhost/46305] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:30,634 INFO [Listener at localhost/46305] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:30,634 INFO [Listener at localhost/46305] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:30,634 INFO [Listener at localhost/46305] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:30,634 INFO [Listener at localhost/46305] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:30,635 INFO [Listener at localhost/46305] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:30,635 INFO [Listener at localhost/46305] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:30,635 INFO [Listener at localhost/46305] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44545 2023-02-08 13:03:30,635 INFO [Listener at localhost/46305] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:03:30,636 DEBUG [Listener at localhost/46305] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:30,636 INFO [Listener at localhost/46305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:30,637 INFO [Listener at localhost/46305] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:30,638 INFO [Listener at localhost/46305] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44545 connecting to ZooKeeper ensemble=127.0.0.1:59811 2023-02-08 13:03:30,640 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:445450x0, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:30,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44545-0x1003407aca00002 connected 2023-02-08 13:03:30,641 DEBUG [Listener at localhost/46305] zookeeper.ZKUtil(164): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:30,642 DEBUG [Listener at localhost/46305] zookeeper.ZKUtil(164): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:30,642 DEBUG [Listener at localhost/46305] zookeeper.ZKUtil(164): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:30,644 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44545 2023-02-08 13:03:30,644 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44545 2023-02-08 13:03:30,646 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44545 2023-02-08 13:03:30,647 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44545 2023-02-08 13:03:30,647 DEBUG [Listener at localhost/46305] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44545 2023-02-08 13:03:30,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37177,1675861410548 2023-02-08 13:03:30,650 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:03:30,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37177,1675861410548 2023-02-08 13:03:30,651 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:30,651 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:30,651 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:30,651 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:30,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:03:30,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:03:30,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37177,1675861410548 from backup master directory 2023-02-08 13:03:30,657 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37177,1675861410548 2023-02-08 13:03:30,657 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:03:30,657 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:30,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37177,1675861410548 2023-02-08 13:03:30,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/hbase.id with ID: b54f3469-64a9-4acf-8e08-06f608bc9399 2023-02-08 13:03:30,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:30,686 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:30,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4406e2ec to 127.0.0.1:59811 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:30,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@213694fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:30,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:30,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 13:03:30,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:30,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/MasterData/data/master/store-tmp 2023-02-08 13:03:30,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:30,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:03:30,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:30,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:30,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:03:30,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:30,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:30,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861410711Disabling compacts and flushes for region at 1675861410711Disabling writes for close at 1675861410711Writing region close event to WAL at 1675861410711Closed at 1675861410711 2023-02-08 13:03:30,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/MasterData/WALs/jenkins-hbase4.apache.org,37177,1675861410548 2023-02-08 13:03:30,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37177%2C1675861410548, suffix=, logDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/MasterData/WALs/jenkins-hbase4.apache.org,37177,1675861410548, archiveDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/MasterData/oldWALs, maxLogs=10 2023-02-08 13:03:30,727 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44601,DS-5746585f-f8c1-474b-9861-cf1b7cf78db0,DISK] 2023-02-08 13:03:30,727 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44869,DS-89ae809f-4987-4957-ae8f-195bb4ad8dab,DISK] 2023-02-08 13:03:30,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/MasterData/WALs/jenkins-hbase4.apache.org,37177,1675861410548/jenkins-hbase4.apache.org%2C37177%2C1675861410548.1675861410714 2023-02-08 13:03:30,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44601,DS-5746585f-f8c1-474b-9861-cf1b7cf78db0,DISK], DatanodeInfoWithStorage[127.0.0.1:44869,DS-89ae809f-4987-4957-ae8f-195bb4ad8dab,DISK]] 2023-02-08 13:03:30,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:30,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:30,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:30,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:30,730 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:30,731 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 13:03:30,731 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 13:03:30,732 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:30,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:30,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:30,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:30,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:30,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73397906, jitterRate=0.09371402859687805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:03:30,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675861410729Initializing all the Stores at 1675861410730 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861410730Cleaning up temporary data from old regions at 1675861410733 (+3 ms)Cleaning up detritus from prior splits at 1675861410733Region opened successfully at 1675861410737 (+4 ms) 2023-02-08 13:03:30,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 13:03:30,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 13:03:30,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 13:03:30,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 13:03:30,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-08 13:03:30,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-08 13:03:30,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 13:03:30,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 13:03:30,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 13:03:30,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 13:03:30,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 13:03:30,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 13:03:30,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 13:03:30,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 13:03:30,752 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:30,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 13:03:30,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 13:03:30,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 13:03:30,756 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:30,756 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:30,756 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:30,756 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:30,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37177,1675861410548, sessionid=0x1003407aca00000, setting cluster-up flag (Was=false) 2023-02-08 13:03:30,761 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:30,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 13:03:30,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37177,1675861410548 2023-02-08 13:03:30,767 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:30,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 13:03:30,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37177,1675861410548 2023-02-08 13:03:30,773 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.hbase-snapshot/.tmp 2023-02-08 13:03:30,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:30,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:30,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:30,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:30,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:30,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 13:03:30,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:30,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675861440776 2023-02-08 13:03:30,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 13:03:30,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 13:03:30,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 13:03:30,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 13:03:30,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 13:03:30,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 13:03:30,776 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:30,776 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 13:03:30,777 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:30,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 13:03:30,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 13:03:30,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 13:03:30,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 13:03:30,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 13:03:30,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861410782,5,FailOnTimeoutGroup] 2023-02-08 13:03:30,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861410782,5,FailOnTimeoutGroup] 2023-02-08 13:03:30,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 13:03:30,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,790 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:30,790 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:30,791 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2 2023-02-08 13:03:30,796 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:30,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:03:30,798 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/info 2023-02-08 13:03:30,798 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:03:30,798 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:30,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:03:30,799 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:30,800 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:03:30,800 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:30,800 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:03:30,801 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/table 2023-02-08 13:03:30,801 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:03:30,802 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:30,802 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740 2023-02-08 13:03:30,802 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740 2023-02-08 13:03:30,804 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:03:30,805 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:03:30,806 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:30,806 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63765140, jitterRate=-0.04982537031173706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:03:30,806 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675861410796Initializing all the Stores at 1675861410797 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861410797Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861410797Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861410797Cleaning up temporary data from old regions at 1675861410803 (+6 ms)Cleaning up detritus from prior splits at 1675861410803Region opened successfully at 1675861410806 (+3 ms) 2023-02-08 13:03:30,807 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:03:30,807 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:03:30,807 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:03:30,807 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:03:30,807 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:03:30,807 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:30,807 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861410807Disabling compacts and flushes for region at 1675861410807Disabling writes for close at 1675861410807Writing region close event to WAL at 1675861410807Closed at 1675861410807 2023-02-08 13:03:30,807 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:30,808 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 13:03:30,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 13:03:30,809 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 13:03:30,810 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 13:03:30,849 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(952): ClusterId : b54f3469-64a9-4acf-8e08-06f608bc9399 2023-02-08 13:03:30,849 INFO [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(952): ClusterId : b54f3469-64a9-4acf-8e08-06f608bc9399 2023-02-08 13:03:30,849 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:03:30,849 DEBUG [RS:1;jenkins-hbase4:44545] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:03:30,851 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:03:30,851 DEBUG [RS:1;jenkins-hbase4:44545] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:03:30,851 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:03:30,851 DEBUG [RS:1;jenkins-hbase4:44545] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:03:30,854 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:03:30,854 DEBUG [RS:1;jenkins-hbase4:44545] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:03:30,855 DEBUG [RS:0;jenkins-hbase4:35459] zookeeper.ReadOnlyZKClient(139): Connect 0x40e60343 to 127.0.0.1:59811 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:30,855 DEBUG [RS:1;jenkins-hbase4:44545] zookeeper.ReadOnlyZKClient(139): Connect 0x743d4233 to 127.0.0.1:59811 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:30,858 DEBUG [RS:0;jenkins-hbase4:35459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e21e52f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:30,858 DEBUG [RS:0;jenkins-hbase4:35459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a1e6833, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:30,858 DEBUG [RS:1;jenkins-hbase4:44545] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7afab2c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:30,858 DEBUG [RS:1;jenkins-hbase4:44545] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ec52943, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:30,866 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35459 2023-02-08 13:03:30,866 INFO [RS:0;jenkins-hbase4:35459] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:03:30,867 INFO [RS:0;jenkins-hbase4:35459] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:03:30,867 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:03:30,867 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37177,1675861410548 with isa=jenkins-hbase4.apache.org/172.31.14.131:35459, startcode=1675861410602 2023-02-08 13:03:30,867 DEBUG [RS:0;jenkins-hbase4:35459] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:03:30,869 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36913, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:03:30,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:30,870 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2 2023-02-08 13:03:30,870 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43357 2023-02-08 13:03:30,870 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:03:30,871 DEBUG [RS:1;jenkins-hbase4:44545] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44545 2023-02-08 13:03:30,871 INFO [RS:1;jenkins-hbase4:44545] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:03:30,871 INFO [RS:1;jenkins-hbase4:44545] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:03:30,871 DEBUG [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:03:30,872 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:30,872 INFO [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37177,1675861410548 with isa=jenkins-hbase4.apache.org/172.31.14.131:44545, startcode=1675861410634 2023-02-08 13:03:30,872 DEBUG [RS:0;jenkins-hbase4:35459] zookeeper.ZKUtil(162): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:30,872 DEBUG [RS:1;jenkins-hbase4:44545] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:03:30,872 WARN [RS:0;jenkins-hbase4:35459] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:30,873 INFO [RS:0;jenkins-hbase4:35459] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:30,873 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/WALs/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:30,873 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35459,1675861410602] 2023-02-08 13:03:30,875 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50851, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:03:30,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:30,876 DEBUG [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2 2023-02-08 13:03:30,876 DEBUG [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43357 2023-02-08 13:03:30,876 DEBUG [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:03:30,876 DEBUG [RS:0;jenkins-hbase4:35459] zookeeper.ZKUtil(162): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:30,881 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:30,881 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:30,882 DEBUG [RS:1;jenkins-hbase4:44545] zookeeper.ZKUtil(162): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:30,882 WARN [RS:1;jenkins-hbase4:44545] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:30,882 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44545,1675861410634] 2023-02-08 13:03:30,882 INFO [RS:1;jenkins-hbase4:44545] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:30,882 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:03:30,882 DEBUG [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/WALs/jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:30,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:30,882 INFO [RS:0;jenkins-hbase4:35459] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:03:30,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:30,885 DEBUG [RS:1;jenkins-hbase4:44545] zookeeper.ZKUtil(162): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:30,886 DEBUG [RS:1;jenkins-hbase4:44545] zookeeper.ZKUtil(162): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:30,886 DEBUG [RS:1;jenkins-hbase4:44545] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:03:30,886 INFO [RS:1;jenkins-hbase4:44545] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:03:30,889 INFO [RS:0;jenkins-hbase4:35459] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:03:30,890 INFO [RS:1;jenkins-hbase4:44545] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:03:30,890 INFO [RS:0;jenkins-hbase4:35459] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:03:30,890 INFO [RS:1;jenkins-hbase4:44545] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:03:30,890 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,890 INFO [RS:1;jenkins-hbase4:44545] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,890 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:03:30,892 INFO [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:03:30,893 INFO [RS:1;jenkins-hbase4:44545] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,893 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,893 DEBUG [RS:1;jenkins-hbase4:44545] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,893 DEBUG [RS:1;jenkins-hbase4:44545] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,894 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,894 DEBUG [RS:1;jenkins-hbase4:44545] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,894 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,894 DEBUG [RS:1;jenkins-hbase4:44545] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,894 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,894 DEBUG [RS:1;jenkins-hbase4:44545] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,894 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,894 DEBUG [RS:1;jenkins-hbase4:44545] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:30,894 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,894 DEBUG [RS:1;jenkins-hbase4:44545] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,894 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:30,894 DEBUG [RS:1;jenkins-hbase4:44545] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,894 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,894 DEBUG [RS:1;jenkins-hbase4:44545] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,895 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,895 DEBUG [RS:1;jenkins-hbase4:44545] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,895 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,895 DEBUG [RS:0;jenkins-hbase4:35459] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:30,896 INFO [RS:1;jenkins-hbase4:44545] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,896 INFO [RS:1;jenkins-hbase4:44545] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,896 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,896 INFO [RS:1;jenkins-hbase4:44545] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,896 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,896 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,911 INFO [RS:0;jenkins-hbase4:35459] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:03:30,911 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35459,1675861410602-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,911 INFO [RS:1;jenkins-hbase4:44545] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:03:30,911 INFO [RS:1;jenkins-hbase4:44545] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44545,1675861410634-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:30,921 INFO [RS:0;jenkins-hbase4:35459] regionserver.Replication(203): jenkins-hbase4.apache.org,35459,1675861410602 started 2023-02-08 13:03:30,921 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35459,1675861410602, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35459, sessionid=0x1003407aca00001 2023-02-08 13:03:30,921 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:03:30,921 DEBUG [RS:0;jenkins-hbase4:35459] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:30,921 DEBUG [RS:0;jenkins-hbase4:35459] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35459,1675861410602' 2023-02-08 13:03:30,921 DEBUG [RS:0;jenkins-hbase4:35459] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:30,921 DEBUG [RS:0;jenkins-hbase4:35459] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:30,922 INFO [RS:1;jenkins-hbase4:44545] regionserver.Replication(203): jenkins-hbase4.apache.org,44545,1675861410634 started 2023-02-08 13:03:30,922 INFO [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44545,1675861410634, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44545, sessionid=0x1003407aca00002 2023-02-08 13:03:30,922 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:03:30,922 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:03:30,922 DEBUG [RS:1;jenkins-hbase4:44545] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:03:30,922 DEBUG [RS:1;jenkins-hbase4:44545] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:30,922 DEBUG [RS:1;jenkins-hbase4:44545] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44545,1675861410634' 2023-02-08 13:03:30,922 DEBUG [RS:0;jenkins-hbase4:35459] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:30,922 DEBUG [RS:0;jenkins-hbase4:35459] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35459,1675861410602' 2023-02-08 13:03:30,922 DEBUG [RS:0;jenkins-hbase4:35459] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:30,922 DEBUG [RS:1;jenkins-hbase4:44545] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:30,922 DEBUG [RS:0;jenkins-hbase4:35459] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:30,922 DEBUG [RS:1;jenkins-hbase4:44545] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:30,923 DEBUG [RS:0;jenkins-hbase4:35459] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:03:30,923 DEBUG [RS:1;jenkins-hbase4:44545] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:03:30,923 DEBUG [RS:1;jenkins-hbase4:44545] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:03:30,923 DEBUG [RS:1;jenkins-hbase4:44545] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:30,923 DEBUG [RS:1;jenkins-hbase4:44545] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44545,1675861410634' 2023-02-08 13:03:30,923 INFO [RS:0;jenkins-hbase4:35459] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:03:30,923 INFO [RS:0;jenkins-hbase4:35459] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:03:30,923 DEBUG [RS:1;jenkins-hbase4:44545] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:30,923 DEBUG [RS:1;jenkins-hbase4:44545] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:30,923 DEBUG [RS:1;jenkins-hbase4:44545] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:03:30,923 INFO [RS:1;jenkins-hbase4:44545] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:03:30,923 INFO [RS:1;jenkins-hbase4:44545] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:03:30,960 DEBUG [jenkins-hbase4:37177] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 13:03:30,960 DEBUG [jenkins-hbase4:37177] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:30,962 DEBUG [jenkins-hbase4:37177] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:30,962 DEBUG [jenkins-hbase4:37177] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:30,962 DEBUG [jenkins-hbase4:37177] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:30,962 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44545,1675861410634, state=OPENING 2023-02-08 13:03:30,963 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 13:03:30,964 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:30,965 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:03:30,965 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44545,1675861410634}] 2023-02-08 13:03:31,120 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:31,120 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 13:03:31,121 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49846, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 13:03:31,125 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 13:03:31,125 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:31,126 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44545%2C1675861410634.meta, suffix=.meta, logDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/WALs/jenkins-hbase4.apache.org,44545,1675861410634, archiveDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/oldWALs, maxLogs=32 2023-02-08 13:03:31,139 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44601,DS-5746585f-f8c1-474b-9861-cf1b7cf78db0,DISK] 2023-02-08 13:03:31,139 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44869,DS-89ae809f-4987-4957-ae8f-195bb4ad8dab,DISK] 2023-02-08 13:03:31,140 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/WALs/jenkins-hbase4.apache.org,44545,1675861410634/jenkins-hbase4.apache.org%2C44545%2C1675861410634.meta.1675861411126.meta 2023-02-08 13:03:31,141 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44601,DS-5746585f-f8c1-474b-9861-cf1b7cf78db0,DISK], DatanodeInfoWithStorage[127.0.0.1:44869,DS-89ae809f-4987-4957-ae8f-195bb4ad8dab,DISK]] 2023-02-08 13:03:31,141 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:31,141 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 13:03:31,141 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 13:03:31,141 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 13:03:31,141 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 13:03:31,141 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:31,141 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 13:03:31,141 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 13:03:31,142 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:03:31,143 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/info 2023-02-08 13:03:31,143 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/info 2023-02-08 13:03:31,144 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:03:31,144 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:31,144 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:03:31,145 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:31,145 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:31,145 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:03:31,145 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:31,145 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:03:31,146 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/table 2023-02-08 13:03:31,146 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/table 2023-02-08 13:03:31,146 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:03:31,146 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:31,147 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740 2023-02-08 13:03:31,148 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740 2023-02-08 13:03:31,150 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:03:31,151 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:03:31,151 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74257452, jitterRate=0.10652226209640503}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:03:31,151 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675861411141Writing region info on filesystem at 1675861411141Initializing all the Stores at 1675861411142 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861411142Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861411142Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861411142Cleaning up temporary data from old regions at 1675861411149 (+7 ms)Cleaning up detritus from prior splits at 1675861411149Running coprocessor post-open hooks at 1675861411151 (+2 ms)Region opened successfully at 1675861411151 2023-02-08 13:03:31,152 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675861411120 2023-02-08 13:03:31,158 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 13:03:31,158 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 13:03:31,159 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44545,1675861410634, state=OPEN 2023-02-08 13:03:31,160 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 13:03:31,160 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:03:31,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 13:03:31,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44545,1675861410634 in 195 msec 2023-02-08 13:03:31,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 13:03:31,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-08 13:03:31,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 390 msec 2023-02-08 13:03:31,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675861410650, completionTime=-1 2023-02-08 13:03:31,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 13:03:31,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 13:03:31,165 DEBUG [hconnection-0x1555dde0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:31,166 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49852, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:31,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 13:03:31,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675861471168 2023-02-08 13:03:31,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675861531168 2023-02-08 13:03:31,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-08 13:03:31,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37177,1675861410548-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:31,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37177,1675861410548-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:31,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37177,1675861410548-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:31,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37177, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:31,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:31,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 13:03:31,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:31,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 13:03:31,180 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 13:03:31,181 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:03:31,182 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:03:31,183 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/hbase/namespace/bf024007588deea9cc4fb57bf5ba2657 2023-02-08 13:03:31,184 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/hbase/namespace/bf024007588deea9cc4fb57bf5ba2657 empty. 2023-02-08 13:03:31,184 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/hbase/namespace/bf024007588deea9cc4fb57bf5ba2657 2023-02-08 13:03:31,184 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 13:03:31,198 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:31,199 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => bf024007588deea9cc4fb57bf5ba2657, NAME => 'hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp 2023-02-08 13:03:31,212 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:31,212 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing bf024007588deea9cc4fb57bf5ba2657, disabling compactions & flushes 2023-02-08 13:03:31,212 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. 2023-02-08 13:03:31,212 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. 2023-02-08 13:03:31,212 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. after waiting 0 ms 2023-02-08 13:03:31,212 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. 2023-02-08 13:03:31,212 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. 2023-02-08 13:03:31,212 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for bf024007588deea9cc4fb57bf5ba2657: Waiting for close lock at 1675861411212Disabling compacts and flushes for region at 1675861411212Disabling writes for close at 1675861411212Writing region close event to WAL at 1675861411212Closed at 1675861411212 2023-02-08 13:03:31,214 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:03:31,214 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861411214"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861411214"}]},"ts":"1675861411214"} 2023-02-08 13:03:31,216 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 13:03:31,216 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:03:31,216 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861411216"}]},"ts":"1675861411216"} 2023-02-08 13:03:31,217 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 13:03:31,220 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:31,220 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:31,220 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:31,220 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:31,220 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bf024007588deea9cc4fb57bf5ba2657, ASSIGN}] 2023-02-08 13:03:31,223 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bf024007588deea9cc4fb57bf5ba2657, ASSIGN 2023-02-08 13:03:31,223 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=bf024007588deea9cc4fb57bf5ba2657, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35459,1675861410602; forceNewPlan=false, retain=false 2023-02-08 13:03:31,374 INFO [jenkins-hbase4:37177] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 13:03:31,374 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bf024007588deea9cc4fb57bf5ba2657, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:31,374 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861411374"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861411374"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861411374"}]},"ts":"1675861411374"} 2023-02-08 13:03:31,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure bf024007588deea9cc4fb57bf5ba2657, server=jenkins-hbase4.apache.org,35459,1675861410602}] 2023-02-08 13:03:31,528 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:31,528 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 13:03:31,530 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53502, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 13:03:31,534 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. 2023-02-08 13:03:31,535 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35459%2C1675861410602, suffix=, logDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/WALs/jenkins-hbase4.apache.org,35459,1675861410602, archiveDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/oldWALs, maxLogs=32 2023-02-08 13:03:31,556 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44869,DS-89ae809f-4987-4957-ae8f-195bb4ad8dab,DISK] 2023-02-08 13:03:31,556 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44601,DS-5746585f-f8c1-474b-9861-cf1b7cf78db0,DISK] 2023-02-08 13:03:31,557 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/WALs/jenkins-hbase4.apache.org,35459,1675861410602/jenkins-hbase4.apache.org%2C35459%2C1675861410602.1675861411536 2023-02-08 13:03:31,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44869,DS-89ae809f-4987-4957-ae8f-195bb4ad8dab,DISK], DatanodeInfoWithStorage[127.0.0.1:44601,DS-5746585f-f8c1-474b-9861-cf1b7cf78db0,DISK]] 2023-02-08 13:03:31,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bf024007588deea9cc4fb57bf5ba2657, NAME => 'hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:31,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace bf024007588deea9cc4fb57bf5ba2657 2023-02-08 13:03:31,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:31,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bf024007588deea9cc4fb57bf5ba2657 2023-02-08 13:03:31,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bf024007588deea9cc4fb57bf5ba2657 2023-02-08 13:03:31,559 INFO [StoreOpener-bf024007588deea9cc4fb57bf5ba2657-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region bf024007588deea9cc4fb57bf5ba2657 2023-02-08 13:03:31,560 DEBUG [StoreOpener-bf024007588deea9cc4fb57bf5ba2657-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/namespace/bf024007588deea9cc4fb57bf5ba2657/info 2023-02-08 13:03:31,560 DEBUG [StoreOpener-bf024007588deea9cc4fb57bf5ba2657-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/namespace/bf024007588deea9cc4fb57bf5ba2657/info 2023-02-08 13:03:31,560 INFO [StoreOpener-bf024007588deea9cc4fb57bf5ba2657-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf024007588deea9cc4fb57bf5ba2657 columnFamilyName info 2023-02-08 13:03:31,561 INFO [StoreOpener-bf024007588deea9cc4fb57bf5ba2657-1] regionserver.HStore(310): Store=bf024007588deea9cc4fb57bf5ba2657/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:31,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/namespace/bf024007588deea9cc4fb57bf5ba2657 2023-02-08 13:03:31,562 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/namespace/bf024007588deea9cc4fb57bf5ba2657 2023-02-08 13:03:31,563 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bf024007588deea9cc4fb57bf5ba2657 2023-02-08 13:03:31,565 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/namespace/bf024007588deea9cc4fb57bf5ba2657/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:31,565 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bf024007588deea9cc4fb57bf5ba2657; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60767195, jitterRate=-0.09449823200702667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:03:31,565 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bf024007588deea9cc4fb57bf5ba2657: Running coprocessor pre-open hook at 1675861411558Writing region info on filesystem at 1675861411558Initializing all the Stores at 1675861411559 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861411559Cleaning up temporary data from old regions at 1675861411562 (+3 ms)Cleaning up detritus from prior splits at 1675861411562Running coprocessor post-open hooks at 1675861411565 (+3 ms)Region opened successfully at 1675861411565 2023-02-08 13:03:31,566 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657., pid=6, masterSystemTime=1675861411528 2023-02-08 13:03:31,568 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. 2023-02-08 13:03:31,569 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. 2023-02-08 13:03:31,569 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bf024007588deea9cc4fb57bf5ba2657, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:31,569 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861411569"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861411569"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861411569"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861411569"}]},"ts":"1675861411569"} 2023-02-08 13:03:31,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 13:03:31,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure bf024007588deea9cc4fb57bf5ba2657, server=jenkins-hbase4.apache.org,35459,1675861410602 in 195 msec 2023-02-08 13:03:31,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 13:03:31,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=bf024007588deea9cc4fb57bf5ba2657, ASSIGN in 352 msec 2023-02-08 13:03:31,573 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:03:31,574 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861411573"}]},"ts":"1675861411573"} 2023-02-08 13:03:31,575 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 13:03:31,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 13:03:31,581 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:03:31,582 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:31,582 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:31,582 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 402 msec 2023-02-08 13:03:31,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:31,585 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53504, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:31,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 13:03:31,592 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:31,595 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-08 13:03:31,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 13:03:31,604 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:31,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-08 13:03:31,611 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 13:03:31,614 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 13:03:31,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.957sec 2023-02-08 13:03:31,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 13:03:31,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 13:03:31,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 13:03:31,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37177,1675861410548-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 13:03:31,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37177,1675861410548-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 13:03:31,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 13:03:31,651 DEBUG [Listener at localhost/46305] zookeeper.ReadOnlyZKClient(139): Connect 0x69bdee28 to 127.0.0.1:59811 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:31,653 DEBUG [Listener at localhost/46305] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@373a1951, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:31,655 DEBUG [hconnection-0x5b9309ab-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:31,656 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49856, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:31,657 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37177,1675861410548 2023-02-08 13:03:31,657 DEBUG [Listener at localhost/46305] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 13:03:31,657 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:31,657 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:31,659 DEBUG [Listener at localhost/46305] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 13:03:31,661 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39526, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 13:03:31,661 INFO [Listener at localhost/46305] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:31,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:31,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 13:03:31,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:39526 deadline: 1675861471662, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:31,662 INFO [Listener at localhost/46305] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-08 13:03:31,663 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:31,663 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:31,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:31,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:31,666 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:03:31,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-08 13:03:31,667 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:31,667 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:31,667 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:03:31,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:31,668 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:31,669 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430 empty. 2023-02-08 13:03:31,669 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:31,669 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-08 13:03:31,680 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:31,681 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5ff19adc9bebf9d1b8420fb618cf9430, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp 2023-02-08 13:03:31,689 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:31,690 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 5ff19adc9bebf9d1b8420fb618cf9430, disabling compactions & flushes 2023-02-08 13:03:31,690 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:31,690 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:31,690 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. after waiting 0 ms 2023-02-08 13:03:31,690 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:31,690 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:31,690 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 5ff19adc9bebf9d1b8420fb618cf9430: Waiting for close lock at 1675861411690Disabling compacts and flushes for region at 1675861411690Disabling writes for close at 1675861411690Writing region close event to WAL at 1675861411690Closed at 1675861411690 2023-02-08 13:03:31,692 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:03:31,692 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675861411692"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861411692"}]},"ts":"1675861411692"} 2023-02-08 13:03:31,694 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 13:03:31,694 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:03:31,694 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861411694"}]},"ts":"1675861411694"} 2023-02-08 13:03:31,695 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-08 13:03:31,699 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:31,700 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:31,700 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:31,700 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:31,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=5ff19adc9bebf9d1b8420fb618cf9430, ASSIGN}] 2023-02-08 13:03:31,702 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=5ff19adc9bebf9d1b8420fb618cf9430, ASSIGN 2023-02-08 13:03:31,703 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=5ff19adc9bebf9d1b8420fb618cf9430, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35459,1675861410602; forceNewPlan=false, retain=false 2023-02-08 13:03:31,768 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:31,768 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:31,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:31,853 INFO [jenkins-hbase4:37177] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 13:03:31,853 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5ff19adc9bebf9d1b8420fb618cf9430, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:31,853 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675861411853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861411853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861411853"}]},"ts":"1675861411853"} 2023-02-08 13:03:31,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 5ff19adc9bebf9d1b8420fb618cf9430, server=jenkins-hbase4.apache.org,35459,1675861410602}] 2023-02-08 13:03:31,926 INFO [RS:1;jenkins-hbase4:44545] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44545%2C1675861410634, suffix=, logDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/WALs/jenkins-hbase4.apache.org,44545,1675861410634, archiveDir=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/oldWALs, maxLogs=32 2023-02-08 13:03:31,939 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44601,DS-5746585f-f8c1-474b-9861-cf1b7cf78db0,DISK] 2023-02-08 13:03:31,939 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44869,DS-89ae809f-4987-4957-ae8f-195bb4ad8dab,DISK] 2023-02-08 13:03:31,940 INFO [RS:1;jenkins-hbase4:44545] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/WALs/jenkins-hbase4.apache.org,44545,1675861410634/jenkins-hbase4.apache.org%2C44545%2C1675861410634.1675861411926 2023-02-08 13:03:31,941 DEBUG [RS:1;jenkins-hbase4:44545] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44601,DS-5746585f-f8c1-474b-9861-cf1b7cf78db0,DISK], DatanodeInfoWithStorage[127.0.0.1:44869,DS-89ae809f-4987-4957-ae8f-195bb4ad8dab,DISK]] 2023-02-08 13:03:31,949 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-08 13:03:31,969 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:31,970 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:31,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:32,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:32,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5ff19adc9bebf9d1b8420fb618cf9430, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:32,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:32,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:32,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:32,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:32,014 INFO [StoreOpener-5ff19adc9bebf9d1b8420fb618cf9430-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:32,015 DEBUG [StoreOpener-5ff19adc9bebf9d1b8420fb618cf9430-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1 2023-02-08 13:03:32,015 DEBUG [StoreOpener-5ff19adc9bebf9d1b8420fb618cf9430-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1 2023-02-08 13:03:32,016 INFO [StoreOpener-5ff19adc9bebf9d1b8420fb618cf9430-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ff19adc9bebf9d1b8420fb618cf9430 columnFamilyName f1 2023-02-08 13:03:32,016 INFO [StoreOpener-5ff19adc9bebf9d1b8420fb618cf9430-1] regionserver.HStore(310): Store=5ff19adc9bebf9d1b8420fb618cf9430/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:32,016 INFO [StoreOpener-5ff19adc9bebf9d1b8420fb618cf9430-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:32,017 DEBUG [StoreOpener-5ff19adc9bebf9d1b8420fb618cf9430-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2 2023-02-08 13:03:32,017 DEBUG [StoreOpener-5ff19adc9bebf9d1b8420fb618cf9430-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2 2023-02-08 13:03:32,018 INFO [StoreOpener-5ff19adc9bebf9d1b8420fb618cf9430-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ff19adc9bebf9d1b8420fb618cf9430 columnFamilyName f2 2023-02-08 13:03:32,018 INFO [StoreOpener-5ff19adc9bebf9d1b8420fb618cf9430-1] regionserver.HStore(310): Store=5ff19adc9bebf9d1b8420fb618cf9430/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:32,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:32,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:32,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:32,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:32,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:32,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5ff19adc9bebf9d1b8420fb618cf9430; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63147388, jitterRate=-0.05903059244155884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:32,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5ff19adc9bebf9d1b8420fb618cf9430: Running coprocessor pre-open hook at 1675861412013Writing region info on filesystem at 1675861412013Initializing all the Stores at 1675861412014 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861412014Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861412014Cleaning up temporary data from old regions at 1675861412020 (+6 ms)Cleaning up detritus from prior splits at 1675861412020Running coprocessor post-open hooks at 1675861412025 (+5 ms)Region opened successfully at 1675861412025 2023-02-08 13:03:32,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430., pid=12, masterSystemTime=1675861412008 2023-02-08 13:03:32,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:32,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:32,031 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5ff19adc9bebf9d1b8420fb618cf9430, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,031 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675861412031"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861412031"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861412031"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861412031"}]},"ts":"1675861412031"} 2023-02-08 13:03:32,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-08 13:03:32,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 5ff19adc9bebf9d1b8420fb618cf9430, server=jenkins-hbase4.apache.org,35459,1675861410602 in 178 msec 2023-02-08 13:03:32,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-08 13:03:32,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=5ff19adc9bebf9d1b8420fb618cf9430, ASSIGN in 334 msec 2023-02-08 13:03:32,037 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:03:32,037 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861412037"}]},"ts":"1675861412037"} 2023-02-08 13:03:32,038 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-08 13:03:32,041 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:03:32,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 376 msec 2023-02-08 13:03:32,271 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:32,271 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:32,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:32,273 INFO [Listener at localhost/46305] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-08 13:03:32,273 DEBUG [Listener at localhost/46305] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-08 13:03:32,273 INFO [Listener at localhost/46305] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:03:32,275 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-08 13:03:32,275 INFO [Listener at localhost/46305] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:03:32,275 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-08 13:03:32,275 INFO [Listener at localhost/46305] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 13:03:32,287 DEBUG [hconnection-0x5b9309ab-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:32,299 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53516, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:32,306 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35459] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:32,389 INFO [Listener at localhost/46305] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 13:03:32,389 INFO [Listener at localhost/46305] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 13:03:32,389 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:32,389 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:32,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-08 13:03:32,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675861412390 (current time:1675861412390). 2023-02-08 13:03:32,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 13:03:32,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] zookeeper.ReadOnlyZKClient(139): Connect 0x2de53640 to 127.0.0.1:59811 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:32,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fdc4b22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:32,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:32,396 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49870, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:32,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2de53640 to 127.0.0.1:59811 2023-02-08 13:03:32,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:32,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 13:03:32,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-08 13:03:32,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-08 13:03:32,400 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-08 13:03:32,401 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1675862012401 2023-02-08 13:03:32,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-08 13:03:32,401 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,403 DEBUG [Listener at localhost/46305] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 13:03:32,403 DEBUG [Listener at localhost/46305] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 13:03:32,404 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-08 13:03:32,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-08 13:03:32,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 6 msec 2023-02-08 13:03:32,406 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-08 13:03:32,406 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1675862012406 2023-02-08 13:03:32,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-08 13:03:32,420 INFO [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-08 13:03:32,420 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:32,421 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-08 13:03:32,421 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-08 13:03:32,422 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,422 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-08 13:03:32,424 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:32,424 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,424 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:32,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:32,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:32,424 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,424 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:03:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-08 13:03:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-08 13:03:32,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-08 13:03:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-08 13:03:32,425 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-08 13:03:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-08 13:03:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-08 13:03:32,425 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-08 13:03:32,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-08 13:03:32,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-08 13:03:32,426 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-08 13:03:32,426 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:32,426 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-08 13:03:32,427 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-08 13:03:32,427 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-08 13:03:32,427 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:32,427 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44545,1675861410634' joining acquired barrier for procedure (foo) in zk 2023-02-08 13:03:32,427 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-08 13:03:32,427 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-08 13:03:32,427 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35459,1675861410602' joining acquired barrier for procedure (foo) in zk 2023-02-08 13:03:32,429 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:32,429 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,429 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-08 13:03:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:32,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:32,429 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:32,429 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:32,430 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-08 13:03:32,430 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 13:03:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:32,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35459,1675861410602' joining acquired barrier for procedure 'foo' on coordinator 2023-02-08 13:03:32,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75fc19c3[Count = 0] remaining members to acquire global barrier 2023-02-08 13:03:32,431 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-08 13:03:32,431 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:32,432 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 13:03:32,432 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 13:03:32,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:32,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-08 13:03:32,432 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-08 13:03:32,433 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-08 13:03:32,433 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,433 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:03:32,433 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-08 13:03:32,433 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,44545,1675861410634' in zk 2023-02-08 13:03:32,433 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-08 13:03:32,433 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 13:03:32,433 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:32,433 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. started... 2023-02-08 13:03:32,433 INFO [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5ff19adc9bebf9d1b8420fb618cf9430 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-08 13:03:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-08 13:03:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-08 13:03:32,454 INFO [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/.tmp/f1/9cf0e8d41e8f48619134c534e45f7bc4 2023-02-08 13:03:32,472 INFO [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/.tmp/f2/d14e8cf900354cd0a849631953103545 2023-02-08 13:03:32,476 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/.tmp/f1/9cf0e8d41e8f48619134c534e45f7bc4 as hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1/9cf0e8d41e8f48619134c534e45f7bc4 2023-02-08 13:03:32,480 INFO [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1/9cf0e8d41e8f48619134c534e45f7bc4, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 13:03:32,481 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/.tmp/f2/d14e8cf900354cd0a849631953103545 as hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2/d14e8cf900354cd0a849631953103545 2023-02-08 13:03:32,485 INFO [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2/d14e8cf900354cd0a849631953103545, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 13:03:32,486 INFO [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 5ff19adc9bebf9d1b8420fb618cf9430 in 53ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:32,486 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-08 13:03:32,487 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5ff19adc9bebf9d1b8420fb618cf9430: 2023-02-08 13:03:32,487 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.' region-info for snapshot=foo 2023-02-08 13:03:32,487 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:32,487 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1/9cf0e8d41e8f48619134c534e45f7bc4] hfiles 2023-02-08 13:03:32,487 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1/9cf0e8d41e8f48619134c534e45f7bc4 for snapshot=foo 2023-02-08 13:03:32,487 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2/d14e8cf900354cd0a849631953103545] hfiles 2023-02-08 13:03:32,487 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2/d14e8cf900354cd0a849631953103545 for snapshot=foo 2023-02-08 13:03:32,493 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. completed. 2023-02-08 13:03:32,493 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:32,493 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-08 13:03:32,493 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-08 13:03:32,493 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,493 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-08 13:03:32,493 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,35459,1675861410602' in zk 2023-02-08 13:03:32,494 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-08 13:03:32,494 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,494 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:32,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:32,494 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-08 13:03:32,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:32,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:32,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 13:03:32,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:32,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 13:03:32,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,35459,1675861410602': 2023-02-08 13:03:32,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35459,1675861410602' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-08 13:03:32,498 INFO [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-08 13:03:32,499 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:03:32,499 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:03:32,499 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-08 13:03:32,499 INFO [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 13:03:32,501 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,501 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,501 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,501 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:32,501 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,501 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:32,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:32,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:32,502 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 13:03:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 13:03:32,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,503 DEBUG [Listener at localhost/46305] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:32,503 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:32,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,503 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,503 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:32,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:32,503 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-08 13:03:32,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-08 13:03:32,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:03:32,505 DEBUG [Listener at localhost/46305] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 13:03:32,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,516 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:32,516 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:32,516 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:32,516 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:32,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:32,516 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-08 13:03:32,516 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-08 13:03:32,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-08 13:03:32,516 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:32,516 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:32,516 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:32,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:32,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:32,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:32,516 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-08 13:03:32,516 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,517 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 13:03:32,517 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:32,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.hbase-snapshot/.tmp/foo 2023-02-08 13:03:32,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:32,517 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-08 13:03:32,517 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-08 13:03:32,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.hbase-snapshot/.tmp/foo to hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.hbase-snapshot/foo 2023-02-08 13:03:32,561 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-08 13:03:32,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.hbase-snapshot/.tmp/foo 2023-02-08 13:03:32,562 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.hbase-snapshot/.tmp/foo 2023-02-08 13:03:32,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1675861412401Consolidate snapshot: foo at 1675861412516 (+115 ms)Loading Region manifests for foo at 1675861412516Writing data manifest for foo at 1675861412519 (+3 ms)Verifying snapshot: foo at 1675861412530 (+11 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1675861412561 (+31 ms) 2023-02-08 13:03:32,564 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-08 13:03:32,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 162 msec 2023-02-08 13:03:32,705 DEBUG [Listener at localhost/46305] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:32,705 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:32,705 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:32,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-08 13:03:32,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 13:03:32,706 INFO [Listener at localhost/46305] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 13:03:32,707 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:32,707 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:32,710 INFO [Listener at localhost/46305] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 13:03:32,714 INFO [Listener at localhost/46305] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 13:03:32,741 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35459] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:32,825 INFO [Listener at localhost/46305] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 13:03:32,828 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:32,828 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:32,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 13:03:32,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,831 INFO [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-08 13:03:32,831 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:32,832 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-08 13:03:32,832 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-08 13:03:32,833 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,833 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,834 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:32,834 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:32,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:32,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:32,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:32,834 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:32,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,835 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,835 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:03:32,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:03:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:03:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,835 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,835 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,836 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,836 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,836 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-08 13:03:32,836 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:32,836 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-08 13:03:32,837 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-08 13:03:32,837 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:32,837 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-08 13:03:32,837 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:32,837 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 13:03:32,838 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 13:03:32,837 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. started... 2023-02-08 13:03:32,837 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-08 13:03:32,838 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44545,1675861410634' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-08 13:03:32,838 INFO [rs(jenkins-hbase4.apache.org,35459,1675861410602)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5ff19adc9bebf9d1b8420fb618cf9430 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-08 13:03:32,840 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,840 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,840 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:32,853 INFO [rs(jenkins-hbase4.apache.org,35459,1675861410602)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/.tmp/f1/8a957f7d4f1542ad9e4b751cce311bab 2023-02-08 13:03:32,878 INFO [rs(jenkins-hbase4.apache.org,35459,1675861410602)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/.tmp/f2/ca02b785dd3444b5bbb0f954b52e646d 2023-02-08 13:03:32,882 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/.tmp/f1/8a957f7d4f1542ad9e4b751cce311bab as hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1/8a957f7d4f1542ad9e4b751cce311bab 2023-02-08 13:03:32,886 INFO [rs(jenkins-hbase4.apache.org,35459,1675861410602)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1/8a957f7d4f1542ad9e4b751cce311bab, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 13:03:32,886 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/.tmp/f2/ca02b785dd3444b5bbb0f954b52e646d as hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2/ca02b785dd3444b5bbb0f954b52e646d 2023-02-08 13:03:32,890 INFO [rs(jenkins-hbase4.apache.org,35459,1675861410602)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2/ca02b785dd3444b5bbb0f954b52e646d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 13:03:32,891 INFO [rs(jenkins-hbase4.apache.org,35459,1675861410602)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 5ff19adc9bebf9d1b8420fb618cf9430 in 53ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:32,892 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5ff19adc9bebf9d1b8420fb618cf9430: 2023-02-08 13:03:32,892 DEBUG [rs(jenkins-hbase4.apache.org,35459,1675861410602)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:32,892 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 13:03:32,892 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 13:03:32,892 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,892 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-08 13:03:32,892 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35459,1675861410602' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-08 13:03:32,893 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,893 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:32,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:32,894 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,894 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:32,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:32,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:32,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:32,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35459,1675861410602' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-08 13:03:32,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71c393a4[Count = 0] remaining members to acquire global barrier 2023-02-08 13:03:32,895 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-08 13:03:32,895 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,896 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,896 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,897 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-08 13:03:32,897 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,897 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:03:32,897 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-08 13:03:32,897 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-08 13:03:32,897 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,44545,1675861410634' in zk 2023-02-08 13:03:32,897 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-08 13:03:32,897 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,35459,1675861410602' in zk 2023-02-08 13:03:32,898 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,898 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-08 13:03:32,898 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:32,898 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-08 13:03:32,898 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:32,898 DEBUG [member: 'jenkins-hbase4.apache.org,44545,1675861410634' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-08 13:03:32,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:32,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:32,898 DEBUG [member: 'jenkins-hbase4.apache.org,35459,1675861410602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-08 13:03:32,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:32,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:32,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:32,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,35459,1675861410602': 2023-02-08 13:03:32,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35459,1675861410602' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-08 13:03:32,901 INFO [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-08 13:03:32,901 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:03:32,901 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:03:32,901 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,901 INFO [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 13:03:32,903 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,903 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:32,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:32,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,903 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:32,903 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,904 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:32,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:32,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:32,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:32,904 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:32,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:32,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,905 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:32,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:32,906 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,907 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,909 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,909 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,909 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,909 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:32,909 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,909 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:32,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-08 13:03:32,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 13:03:32,909 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:32,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:32,909 DEBUG [(jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:32,909 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:32,909 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:32,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:32,909 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:32,910 DEBUG [Listener at localhost/46305] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-08 13:03:32,910 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:32,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:32,910 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,910 DEBUG [Listener at localhost/46305] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 13:03:32,910 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:32,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:32,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:32,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:32,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:33,010 DEBUG [Listener at localhost/46305] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 13:03:33,010 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:33,010 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:33,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 13:03:33,015 INFO [Listener at localhost/46305] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675861412390 type: FLUSH version: 2 ttl: 0 2023-02-08 13:03:33,016 DEBUG [Listener at localhost/46305] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43357/user/jenkins/test-data/938bfda3-3d89-b956-020a-2cdc78499351/foo/d8e9d707-2027-4f37-b0ea-b6ef02328630/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:33,016 INFO [Listener at localhost/46305] snapshot.RestoreSnapshotHelper(239): region to add: 5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:33,016 INFO [Listener at localhost/46305] snapshot.RestoreSnapshotHelper(585): clone region=5ff19adc9bebf9d1b8420fb618cf9430 as 5ff19adc9bebf9d1b8420fb618cf9430 in snapshot foo 2023-02-08 13:03:33,017 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5ff19adc9bebf9d1b8420fb618cf9430, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43357/user/jenkins/test-data/938bfda3-3d89-b956-020a-2cdc78499351/foo/d8e9d707-2027-4f37-b0ea-b6ef02328630 2023-02-08 13:03:33,022 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:33,022 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9cf0e8d41e8f48619134c534e45f7bc4 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:33,024 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d14e8cf900354cd0a849631953103545 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:33,026 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 5ff19adc9bebf9d1b8420fb618cf9430, disabling compactions & flushes 2023-02-08 13:03:33,026 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:33,026 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:33,026 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. after waiting 0 ms 2023-02-08 13:03:33,026 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:33,026 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:33,026 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 5ff19adc9bebf9d1b8420fb618cf9430: Waiting for close lock at 1675861413026Disabling compacts and flushes for region at 1675861413026Disabling writes for close at 1675861413026Writing region close event to WAL at 1675861413026Closed at 1675861413026 2023-02-08 13:03:33,027 INFO [Listener at localhost/46305] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675861412390 type: FLUSH version: 2 ttl: 0 2023-02-08 13:03:33,027 DEBUG [Listener at localhost/46305] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43357/user/jenkins/test-data/938bfda3-3d89-b956-020a-2cdc78499351/foo/d8e9d707-2027-4f37-b0ea-b6ef02328630 2023-02-08 13:03:33,027 DEBUG [Listener at localhost/46305] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43357/user/jenkins/test-data/938bfda3-3d89-b956-020a-2cdc78499351/foo/d8e9d707-2027-4f37-b0ea-b6ef02328630 2023-02-08 13:03:33,028 DEBUG [Listener at localhost/46305] util.CommonFSUtils(699): |-data/ 2023-02-08 13:03:33,028 DEBUG [Listener at localhost/46305] util.CommonFSUtils(699): |----default/ 2023-02-08 13:03:33,028 DEBUG [Listener at localhost/46305] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-08 13:03:33,029 DEBUG [Listener at localhost/46305] util.CommonFSUtils(699): |----------5ff19adc9bebf9d1b8420fb618cf9430/ 2023-02-08 13:03:33,029 DEBUG [Listener at localhost/46305] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:33,029 DEBUG [Listener at localhost/46305] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:33,029 DEBUG [Listener at localhost/46305] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=5ff19adc9bebf9d1b8420fb618cf9430-9cf0e8d41e8f48619134c534e45f7bc4 2023-02-08 13:03:33,030 DEBUG [Listener at localhost/46305] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:33,030 DEBUG [Listener at localhost/46305] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=5ff19adc9bebf9d1b8420fb618cf9430-d14e8cf900354cd0a849631953103545 hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1/8a957f7d4f1542ad9e4b751cce311bab hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1/9cf0e8d41e8f48619134c534e45f7bc4 hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2/ca02b785dd3444b5bbb0f954b52e646d hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2/d14e8cf900354cd0a849631953103545 2023-02-08 13:03:33,034 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:33,034 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:33,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-08 13:03:33,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-08 13:03:33,037 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:33,038 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:33,038 INFO [Listener at localhost/46305] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:33,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:33,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:33,041 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:33,041 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:33,042 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861413041"}]},"ts":"1675861413041"} 2023-02-08 13:03:33,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 13:03:33,043 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-08 13:03:33,044 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-08 13:03:33,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=5ff19adc9bebf9d1b8420fb618cf9430, UNASSIGN}] 2023-02-08 13:03:33,046 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=5ff19adc9bebf9d1b8420fb618cf9430, UNASSIGN 2023-02-08 13:03:33,047 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5ff19adc9bebf9d1b8420fb618cf9430, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:33,047 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675861413047"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861413047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861413047"}]},"ts":"1675861413047"} 2023-02-08 13:03:33,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 5ff19adc9bebf9d1b8420fb618cf9430, server=jenkins-hbase4.apache.org,35459,1675861410602}] 2023-02-08 13:03:33,142 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:33,142 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:33,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 13:03:33,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:33,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5ff19adc9bebf9d1b8420fb618cf9430, disabling compactions & flushes 2023-02-08 13:03:33,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:33,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:33,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. after waiting 0 ms 2023-02-08 13:03:33,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:33,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:33,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430. 2023-02-08 13:03:33,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5ff19adc9bebf9d1b8420fb618cf9430: Waiting for close lock at 1675861413200Running coprocessor pre-close hooks at 1675861413200Disabling compacts and flushes for region at 1675861413200Disabling writes for close at 1675861413200Writing region close event to WAL at 1675861413201 (+1 ms)Running coprocessor post-close hooks at 1675861413204 (+3 ms)Closed at 1675861413204 2023-02-08 13:03:33,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:33,205 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5ff19adc9bebf9d1b8420fb618cf9430, regionState=CLOSED 2023-02-08 13:03:33,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675861413205"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861413205"}]},"ts":"1675861413205"} 2023-02-08 13:03:33,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-08 13:03:33,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 5ff19adc9bebf9d1b8420fb618cf9430, server=jenkins-hbase4.apache.org,35459,1675861410602 in 159 msec 2023-02-08 13:03:33,209 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-08 13:03:33,209 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=5ff19adc9bebf9d1b8420fb618cf9430, UNASSIGN in 163 msec 2023-02-08 13:03:33,209 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861413209"}]},"ts":"1675861413209"} 2023-02-08 13:03:33,210 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-08 13:03:33,212 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-08 13:03:33,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 174 msec 2023-02-08 13:03:33,344 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:33,344 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:33,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 13:03:33,345 INFO [Listener at localhost/46305] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-08 13:03:33,345 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:33,345 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:33,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:33,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:33,348 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:33,349 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:33,349 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:33,349 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:33,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 13:03:33,352 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:33,354 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1, FileablePath, hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2, FileablePath, hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/recovered.edits] 2023-02-08 13:03:33,356 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1/8a957f7d4f1542ad9e4b751cce311bab to hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1/8a957f7d4f1542ad9e4b751cce311bab 2023-02-08 13:03:33,357 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1/9cf0e8d41e8f48619134c534e45f7bc4 to hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f1/9cf0e8d41e8f48619134c534e45f7bc4 2023-02-08 13:03:33,360 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2/ca02b785dd3444b5bbb0f954b52e646d to hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2/ca02b785dd3444b5bbb0f954b52e646d 2023-02-08 13:03:33,361 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2/d14e8cf900354cd0a849631953103545 to hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/f2/d14e8cf900354cd0a849631953103545 2023-02-08 13:03:33,363 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/recovered.edits/12.seqid to hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430/recovered.edits/12.seqid 2023-02-08 13:03:33,363 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/5ff19adc9bebf9d1b8420fb618cf9430 2023-02-08 13:03:33,363 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-08 13:03:33,365 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:33,366 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-08 13:03:33,367 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-08 13:03:33,371 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:33,371 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-08 13:03:33,371 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861413371"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:33,372 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-08 13:03:33,372 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5ff19adc9bebf9d1b8420fb618cf9430, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675861411664.5ff19adc9bebf9d1b8420fb618cf9430.', STARTKEY => '', ENDKEY => ''}] 2023-02-08 13:03:33,372 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-08 13:03:33,372 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675861413372"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:33,373 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-08 13:03:33,376 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-08 13:03:33,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 30 msec 2023-02-08 13:03:33,450 INFO [Listener at localhost/46305] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:33,450 INFO [Listener at localhost/46305] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:33,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 13:03:33,451 INFO [Listener at localhost/46305] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-08 13:03:33,451 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 13:03:33,451 INFO [Listener at localhost/46305] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 13:03:33,452 DEBUG [Listener at localhost/46305] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69bdee28 to 127.0.0.1:59811 2023-02-08 13:03:33,452 DEBUG [Listener at localhost/46305] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:33,452 DEBUG [Listener at localhost/46305] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 13:03:33,452 DEBUG [Listener at localhost/46305] util.JVMClusterUtil(257): Found active master hash=1361920631, stopped=false 2023-02-08 13:03:33,452 INFO [Listener at localhost/46305] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37177,1675861410548 2023-02-08 13:03:33,454 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:33,454 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:33,454 INFO [Listener at localhost/46305] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 13:03:33,454 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:33,454 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:33,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:33,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:33,455 DEBUG [Listener at localhost/46305] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4406e2ec to 127.0.0.1:59811 2023-02-08 13:03:33,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:33,456 DEBUG [Listener at localhost/46305] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:33,456 INFO [Listener at localhost/46305] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35459,1675861410602' ***** 2023-02-08 13:03:33,456 INFO [Listener at localhost/46305] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:33,456 INFO [Listener at localhost/46305] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44545,1675861410634' ***** 2023-02-08 13:03:33,456 INFO [RS:0;jenkins-hbase4:35459] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:33,456 INFO [Listener at localhost/46305] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:33,456 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:33,456 INFO [RS:0;jenkins-hbase4:35459] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:33,457 INFO [RS:1;jenkins-hbase4:44545] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:33,457 INFO [RS:1;jenkins-hbase4:44545] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:33,457 INFO [RS:1;jenkins-hbase4:44545] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:33,457 INFO [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:33,457 DEBUG [RS:1;jenkins-hbase4:44545] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x743d4233 to 127.0.0.1:59811 2023-02-08 13:03:33,458 DEBUG [RS:1;jenkins-hbase4:44545] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:33,458 INFO [RS:1;jenkins-hbase4:44545] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:33,458 INFO [RS:1;jenkins-hbase4:44545] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:33,458 INFO [RS:1;jenkins-hbase4:44545] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:33,457 INFO [RS:0;jenkins-hbase4:35459] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:33,458 INFO [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 13:03:33,458 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(3304): Received CLOSE for bf024007588deea9cc4fb57bf5ba2657 2023-02-08 13:03:33,457 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:33,458 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:33,459 INFO [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 13:03:33,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bf024007588deea9cc4fb57bf5ba2657, disabling compactions & flushes 2023-02-08 13:03:33,459 DEBUG [RS:0;jenkins-hbase4:35459] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40e60343 to 127.0.0.1:59811 2023-02-08 13:03:33,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. 2023-02-08 13:03:33,459 DEBUG [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-08 13:03:33,459 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:03:33,459 DEBUG [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 13:03:33,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. 2023-02-08 13:03:33,459 DEBUG [RS:0;jenkins-hbase4:35459] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:33,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. after waiting 0 ms 2023-02-08 13:03:33,459 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:03:33,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. 2023-02-08 13:03:33,459 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-08 13:03:33,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing bf024007588deea9cc4fb57bf5ba2657 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 13:03:33,459 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:03:33,459 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1479): Online Regions={bf024007588deea9cc4fb57bf5ba2657=hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657.} 2023-02-08 13:03:33,459 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:03:33,460 DEBUG [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1505): Waiting on bf024007588deea9cc4fb57bf5ba2657 2023-02-08 13:03:33,460 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:03:33,460 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-08 13:03:33,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/namespace/bf024007588deea9cc4fb57bf5ba2657/.tmp/info/a1c1a716821a46339149b261a26538be 2023-02-08 13:03:33,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/.tmp/info/0638a1612b634508bb65cc9c6042f02e 2023-02-08 13:03:33,471 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0638a1612b634508bb65cc9c6042f02e 2023-02-08 13:03:33,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/.tmp/rep_barrier/9ad170d7b81f4ebeab4b7f3d77086a7f 2023-02-08 13:03:33,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/namespace/bf024007588deea9cc4fb57bf5ba2657/.tmp/info/a1c1a716821a46339149b261a26538be as hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/namespace/bf024007588deea9cc4fb57bf5ba2657/info/a1c1a716821a46339149b261a26538be 2023-02-08 13:03:33,486 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ad170d7b81f4ebeab4b7f3d77086a7f 2023-02-08 13:03:33,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/namespace/bf024007588deea9cc4fb57bf5ba2657/info/a1c1a716821a46339149b261a26538be, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 13:03:33,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for bf024007588deea9cc4fb57bf5ba2657 in 30ms, sequenceid=6, compaction requested=false 2023-02-08 13:03:33,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/namespace/bf024007588deea9cc4fb57bf5ba2657/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 13:03:33,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. 2023-02-08 13:03:33,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bf024007588deea9cc4fb57bf5ba2657: Waiting for close lock at 1675861413459Running coprocessor pre-close hooks at 1675861413459Disabling compacts and flushes for region at 1675861413459Disabling writes for close at 1675861413459Obtaining lock to block concurrent updates at 1675861413459Preparing flush snapshotting stores in bf024007588deea9cc4fb57bf5ba2657 at 1675861413459Finished memstore snapshotting hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675861413460 (+1 ms)Flushing stores of hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. at 1675861413460Flushing bf024007588deea9cc4fb57bf5ba2657/info: creating writer at 1675861413460Flushing bf024007588deea9cc4fb57bf5ba2657/info: appending metadata at 1675861413462 (+2 ms)Flushing bf024007588deea9cc4fb57bf5ba2657/info: closing flushed file at 1675861413462Flushing bf024007588deea9cc4fb57bf5ba2657/info: reopening flushed file at 1675861413485 (+23 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for bf024007588deea9cc4fb57bf5ba2657 in 30ms, sequenceid=6, compaction requested=false at 1675861413489 (+4 ms)Writing region close event to WAL at 1675861413490 (+1 ms)Running coprocessor post-close hooks at 1675861413493 (+3 ms)Closed at 1675861413494 (+1 ms) 2023-02-08 13:03:33,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675861411179.bf024007588deea9cc4fb57bf5ba2657. 2023-02-08 13:03:33,496 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/.tmp/table/54efae7d6c054116963c9309e3954bb6 2023-02-08 13:03:33,501 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54efae7d6c054116963c9309e3954bb6 2023-02-08 13:03:33,502 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:33,502 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/.tmp/info/0638a1612b634508bb65cc9c6042f02e as hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/info/0638a1612b634508bb65cc9c6042f02e 2023-02-08 13:03:33,502 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:33,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0638a1612b634508bb65cc9c6042f02e 2023-02-08 13:03:33,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/info/0638a1612b634508bb65cc9c6042f02e, entries=12, sequenceid=21, filesize=6.3 K 2023-02-08 13:03:33,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/.tmp/rep_barrier/9ad170d7b81f4ebeab4b7f3d77086a7f as hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/rep_barrier/9ad170d7b81f4ebeab4b7f3d77086a7f 2023-02-08 13:03:33,511 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ad170d7b81f4ebeab4b7f3d77086a7f 2023-02-08 13:03:33,511 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/rep_barrier/9ad170d7b81f4ebeab4b7f3d77086a7f, entries=1, sequenceid=21, filesize=5.1 K 2023-02-08 13:03:33,512 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/.tmp/table/54efae7d6c054116963c9309e3954bb6 as hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/table/54efae7d6c054116963c9309e3954bb6 2023-02-08 13:03:33,515 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54efae7d6c054116963c9309e3954bb6 2023-02-08 13:03:33,515 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/table/54efae7d6c054116963c9309e3954bb6, entries=4, sequenceid=21, filesize=5.1 K 2023-02-08 13:03:33,516 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=21, compaction requested=false 2023-02-08 13:03:33,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-08 13:03:33,521 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 13:03:33,522 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:33,522 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861413459Running coprocessor pre-close hooks at 1675861413459Disabling compacts and flushes for region at 1675861413459Disabling writes for close at 1675861413460 (+1 ms)Obtaining lock to block concurrent updates at 1675861413460Preparing flush snapshotting stores in 1588230740 at 1675861413460Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1675861413460Flushing stores of hbase:meta,,1.1588230740 at 1675861413460Flushing 1588230740/info: creating writer at 1675861413461 (+1 ms)Flushing 1588230740/info: appending metadata at 1675861413462 (+1 ms)Flushing 1588230740/info: closing flushed file at 1675861413462Flushing 1588230740/rep_barrier: creating writer at 1675861413472 (+10 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675861413473 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675861413473Flushing 1588230740/table: creating writer at 1675861413486 (+13 ms)Flushing 1588230740/table: appending metadata at 1675861413488 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675861413489 (+1 ms)Flushing 1588230740/info: reopening flushed file at 1675861413504 (+15 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675861413508 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675861413512 (+4 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=21, compaction requested=false at 1675861413516 (+4 ms)Writing region close event to WAL at 1675861413518 (+2 ms)Running coprocessor post-close hooks at 1675861413521 (+3 ms)Closed at 1675861413522 (+1 ms) 2023-02-08 13:03:33,522 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:33,659 INFO [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44545,1675861410634; all regions closed. 2023-02-08 13:03:33,660 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35459,1675861410602; all regions closed. 2023-02-08 13:03:33,667 DEBUG [RS:1;jenkins-hbase4:44545] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/oldWALs 2023-02-08 13:03:33,667 INFO [RS:1;jenkins-hbase4:44545] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44545%2C1675861410634.meta:.meta(num 1675861411126) 2023-02-08 13:03:33,667 DEBUG [RS:0;jenkins-hbase4:35459] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/oldWALs 2023-02-08 13:03:33,667 INFO [RS:0;jenkins-hbase4:35459] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35459%2C1675861410602:(num 1675861411536) 2023-02-08 13:03:33,667 DEBUG [RS:0;jenkins-hbase4:35459] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:33,667 INFO [RS:0;jenkins-hbase4:35459] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:33,667 INFO [RS:0;jenkins-hbase4:35459] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:33,668 INFO [RS:0;jenkins-hbase4:35459] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:33,668 INFO [RS:0;jenkins-hbase4:35459] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:33,668 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:33,668 INFO [RS:0;jenkins-hbase4:35459] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:33,669 INFO [RS:0;jenkins-hbase4:35459] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35459 2023-02-08 13:03:33,670 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:33,670 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35459,1675861410602 2023-02-08 13:03:33,671 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:33,671 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:33,671 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:33,671 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35459,1675861410602] 2023-02-08 13:03:33,671 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35459,1675861410602; numProcessing=1 2023-02-08 13:03:33,673 DEBUG [RS:1;jenkins-hbase4:44545] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/oldWALs 2023-02-08 13:03:33,673 INFO [RS:1;jenkins-hbase4:44545] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44545%2C1675861410634:(num 1675861411926) 2023-02-08 13:03:33,673 DEBUG [RS:1;jenkins-hbase4:44545] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:33,673 INFO [RS:1;jenkins-hbase4:44545] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:33,673 INFO [RS:1;jenkins-hbase4:44545] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:33,673 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:33,674 INFO [RS:1;jenkins-hbase4:44545] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44545 2023-02-08 13:03:33,678 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35459,1675861410602 already deleted, retry=false 2023-02-08 13:03:33,678 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35459,1675861410602 expired; onlineServers=1 2023-02-08 13:03:33,679 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:33,679 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44545,1675861410634 2023-02-08 13:03:33,679 ERROR [Listener at localhost/46305-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3a17f26f rejected from java.util.concurrent.ThreadPoolExecutor@3e2861f5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:33,679 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44545,1675861410634] 2023-02-08 13:03:33,679 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44545,1675861410634; numProcessing=2 2023-02-08 13:03:33,680 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44545,1675861410634 already deleted, retry=false 2023-02-08 13:03:33,681 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44545,1675861410634 expired; onlineServers=0 2023-02-08 13:03:33,681 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37177,1675861410548' ***** 2023-02-08 13:03:33,681 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 13:03:33,681 DEBUG [M:0;jenkins-hbase4:37177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5512cc8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:33,682 INFO [M:0;jenkins-hbase4:37177] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37177,1675861410548 2023-02-08 13:03:33,682 INFO [M:0;jenkins-hbase4:37177] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37177,1675861410548; all regions closed. 2023-02-08 13:03:33,682 DEBUG [M:0;jenkins-hbase4:37177] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:33,682 DEBUG [M:0;jenkins-hbase4:37177] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 13:03:33,682 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 13:03:33,682 DEBUG [M:0;jenkins-hbase4:37177] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 13:03:33,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861410782] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861410782,5,FailOnTimeoutGroup] 2023-02-08 13:03:33,682 INFO [M:0;jenkins-hbase4:37177] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 13:03:33,683 INFO [M:0;jenkins-hbase4:37177] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 13:03:33,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861410782] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861410782,5,FailOnTimeoutGroup] 2023-02-08 13:03:33,683 INFO [M:0;jenkins-hbase4:37177] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 13:03:33,683 DEBUG [M:0;jenkins-hbase4:37177] master.HMaster(1502): Stopping service threads 2023-02-08 13:03:33,683 INFO [M:0;jenkins-hbase4:37177] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 13:03:33,684 ERROR [M:0;jenkins-hbase4:37177] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-08 13:03:33,684 INFO [M:0;jenkins-hbase4:37177] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 13:03:33,684 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 13:03:33,685 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:33,685 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:33,685 DEBUG [M:0;jenkins-hbase4:37177] zookeeper.ZKUtil(398): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 13:03:33,685 WARN [M:0;jenkins-hbase4:37177] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 13:03:33,685 INFO [M:0;jenkins-hbase4:37177] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 13:03:33,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:33,686 INFO [M:0;jenkins-hbase4:37177] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 13:03:33,686 DEBUG [M:0;jenkins-hbase4:37177] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:03:33,686 INFO [M:0;jenkins-hbase4:37177] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:33,686 DEBUG [M:0;jenkins-hbase4:37177] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:33,686 DEBUG [M:0;jenkins-hbase4:37177] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:03:33,686 DEBUG [M:0;jenkins-hbase4:37177] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:33,686 INFO [M:0;jenkins-hbase4:37177] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.64 KB heapSize=67.60 KB 2023-02-08 13:03:33,694 INFO [M:0;jenkins-hbase4:37177] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.64 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e2d2332dc479412b93c8b2b659bbea5c 2023-02-08 13:03:33,698 DEBUG [M:0;jenkins-hbase4:37177] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e2d2332dc479412b93c8b2b659bbea5c as hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e2d2332dc479412b93c8b2b659bbea5c 2023-02-08 13:03:33,702 INFO [M:0;jenkins-hbase4:37177] regionserver.HStore(1080): Added hdfs://localhost:43357/user/jenkins/test-data/d73cffb8-52a3-18ac-63e3-2379c3d735f2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e2d2332dc479412b93c8b2b659bbea5c, entries=17, sequenceid=132, filesize=8.7 K 2023-02-08 13:03:33,702 INFO [M:0;jenkins-hbase4:37177] regionserver.HRegion(2947): Finished flush of dataSize ~56.64 KB/58001, heapSize ~67.59 KB/69208, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-08 13:03:33,703 INFO [M:0;jenkins-hbase4:37177] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:33,703 DEBUG [M:0;jenkins-hbase4:37177] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861413686Disabling compacts and flushes for region at 1675861413686Disabling writes for close at 1675861413686Obtaining lock to block concurrent updates at 1675861413686Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675861413686Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58001, getHeapSize=69208, getOffHeapSize=0, getCellsCount=145 at 1675861413686Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675861413687 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675861413687Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675861413689 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675861413689Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675861413699 (+10 ms)Finished flush of dataSize ~56.64 KB/58001, heapSize ~67.59 KB/69208, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1675861413702 (+3 ms)Writing region close event to WAL at 1675861413703 (+1 ms)Closed at 1675861413703 2023-02-08 13:03:33,705 INFO [M:0;jenkins-hbase4:37177] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 13:03:33,705 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:33,706 INFO [M:0;jenkins-hbase4:37177] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37177 2023-02-08 13:03:33,707 DEBUG [M:0;jenkins-hbase4:37177] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37177,1675861410548 already deleted, retry=false 2023-02-08 13:03:33,956 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:33,956 INFO [M:0;jenkins-hbase4:37177] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37177,1675861410548; zookeeper connection closed. 2023-02-08 13:03:33,956 ERROR [Listener at localhost/46305-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f2cce87 rejected from java.util.concurrent.ThreadPoolExecutor@b135bba[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:33,957 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): master:37177-0x1003407aca00000, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:33,957 ERROR [Listener at localhost/46305-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1624d0d4 rejected from java.util.concurrent.ThreadPoolExecutor@b135bba[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:34,056 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:34,056 INFO [RS:1;jenkins-hbase4:44545] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44545,1675861410634; zookeeper connection closed. 2023-02-08 13:03:34,056 ERROR [Listener at localhost/46305-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4f1a4196 rejected from java.util.concurrent.ThreadPoolExecutor@3e2861f5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:34,057 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:44545-0x1003407aca00002, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:34,057 ERROR [Listener at localhost/46305-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3741a1ff rejected from java.util.concurrent.ThreadPoolExecutor@3e2861f5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:34,057 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@30437c30] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@30437c30 2023-02-08 13:03:34,156 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:34,157 INFO [RS:0;jenkins-hbase4:35459] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35459,1675861410602; zookeeper connection closed. 2023-02-08 13:03:34,157 ERROR [Listener at localhost/46305-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@193db02e rejected from java.util.concurrent.ThreadPoolExecutor@1d0237d1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:34,157 DEBUG [Listener at localhost/46305-EventThread] zookeeper.ZKWatcher(600): regionserver:35459-0x1003407aca00001, quorum=127.0.0.1:59811, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:34,157 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6d7cf489] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6d7cf489 2023-02-08 13:03:34,157 ERROR [Listener at localhost/46305-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d5afae0 rejected from java.util.concurrent.ThreadPoolExecutor@1d0237d1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:34,157 INFO [Listener at localhost/46305] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 13:03:34,157 WARN [Listener at localhost/46305] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:34,161 INFO [Listener at localhost/46305] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:34,262 WARN [BP-1843970512-172.31.14.131-1675861409952 heartbeating to localhost/127.0.0.1:43357] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:34,265 WARN [BP-1843970512-172.31.14.131-1675861409952 heartbeating to localhost/127.0.0.1:43357] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1843970512-172.31.14.131-1675861409952 (Datanode Uuid 8b68e206-f049-4706-bac5-8be9c0e66287) service to localhost/127.0.0.1:43357 2023-02-08 13:03:34,266 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/cluster_f5eab605-f986-9221-589c-45475c820bdf/dfs/data/data3/current/BP-1843970512-172.31.14.131-1675861409952] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:34,266 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/cluster_f5eab605-f986-9221-589c-45475c820bdf/dfs/data/data4/current/BP-1843970512-172.31.14.131-1675861409952] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:34,268 WARN [Listener at localhost/46305] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:34,271 INFO [Listener at localhost/46305] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:34,375 WARN [BP-1843970512-172.31.14.131-1675861409952 heartbeating to localhost/127.0.0.1:43357] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:34,375 WARN [BP-1843970512-172.31.14.131-1675861409952 heartbeating to localhost/127.0.0.1:43357] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1843970512-172.31.14.131-1675861409952 (Datanode Uuid d3eea08b-1e39-468e-b146-6d82c619c200) service to localhost/127.0.0.1:43357 2023-02-08 13:03:34,376 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/cluster_f5eab605-f986-9221-589c-45475c820bdf/dfs/data/data1/current/BP-1843970512-172.31.14.131-1675861409952] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:34,376 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/cluster_f5eab605-f986-9221-589c-45475c820bdf/dfs/data/data2/current/BP-1843970512-172.31.14.131-1675861409952] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:34,387 INFO [Listener at localhost/46305] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:34,499 INFO [Listener at localhost/46305] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 13:03:34,514 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 13:03:34,526 INFO [Listener at localhost/46305] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=274 (was 251) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46305 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:43357 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:43357 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:43357 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43357 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37177,1675861410548)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:43357 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:43357 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:43357 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=580 (was 664), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=302 (was 294) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=3824 (was 3880) 2023-02-08 13:03:34,537 INFO [Listener at localhost/46305] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=274, OpenFileDescriptor=580, MaxFileDescriptor=60000, SystemLoadAverage=302, ProcessCount=165, AvailableMemoryMB=3824 2023-02-08 13:03:34,547 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/hadoop.log.dir so I do NOT create it in target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50 2023-02-08 13:03:34,547 WARN [Listener at localhost/46305] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/hadoop.log.dir Erasing configuration value by system value. 2023-02-08 13:03:34,547 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/hadoop.tmp.dir so I do NOT create it in target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50 2023-02-08 13:03:34,547 WARN [Listener at localhost/46305] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/303f0cda-b9d3-0d16-1551-df26a6d712e3/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-08 13:03:34,547 DEBUG [Listener at localhost/46305] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50 2023-02-08 13:03:34,547 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-08 13:03:34,547 INFO [Listener at localhost/46305] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/cluster_be1edee7-869b-81ad-75dc-cda0e0ca5ce7, deleteOnExit=true 2023-02-08 13:03:34,547 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 13:03:34,548 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/test.cache.data in system properties and HBase conf 2023-02-08 13:03:34,548 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 13:03:34,548 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/hadoop.log.dir in system properties and HBase conf 2023-02-08 13:03:34,548 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 13:03:34,548 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 13:03:34,548 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 13:03:34,548 DEBUG [Listener at localhost/46305] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 13:03:34,549 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:03:34,549 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 13:03:34,549 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 13:03:34,549 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:03:34,549 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 13:03:34,549 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 13:03:34,549 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 13:03:34,549 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:03:34,549 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 13:03:34,549 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/nfs.dump.dir in system properties and HBase conf 2023-02-08 13:03:34,550 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/java.io.tmpdir in system properties and HBase conf 2023-02-08 13:03:34,550 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 13:03:34,550 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 13:03:34,550 INFO [Listener at localhost/46305] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 13:03:34,554 WARN [Listener at localhost/46305] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:03:34,554 WARN [Listener at localhost/46305] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:03:34,589 WARN [Listener at localhost/46305] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:34,591 INFO [Listener at localhost/46305] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:34,594 INFO [Listener at localhost/46305] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/java.io.tmpdir/Jetty_localhost_37879_hdfs____w1j3z4/webapp 2023-02-08 13:03:34,686 INFO [Listener at localhost/46305] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37879 2023-02-08 13:03:34,690 WARN [Listener at localhost/46305] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 13:03:34,691 WARN [Listener at localhost/46305] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 13:03:34,780 WARN [Listener at localhost/37591] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:34,795 WARN [Listener at localhost/37591] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:03:34,797 WARN [Listener at localhost/37591] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:34,798 INFO [Listener at localhost/37591] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:34,803 INFO [Listener at localhost/37591] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/java.io.tmpdir/Jetty_localhost_40867_datanode____.dliduk/webapp 2023-02-08 13:03:34,894 INFO [Listener at localhost/37591] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40867 2023-02-08 13:03:34,904 WARN [Listener at localhost/32897] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:34,918 WARN [Listener at localhost/32897] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 13:03:34,920 WARN [Listener at localhost/32897] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 13:03:34,921 INFO [Listener at localhost/32897] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 13:03:34,924 INFO [Listener at localhost/32897] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/java.io.tmpdir/Jetty_localhost_41033_datanode____.yxz4iu/webapp 2023-02-08 13:03:35,010 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x332ba6c4a263d19: Processing first storage report for DS-717ca5b1-251a-4fea-8818-4d4641009e9b from datanode 0ce6840f-8d9f-45e0-9382-383ee6e8b606 2023-02-08 13:03:35,010 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x332ba6c4a263d19: from storage DS-717ca5b1-251a-4fea-8818-4d4641009e9b node DatanodeRegistration(127.0.0.1:41115, datanodeUuid=0ce6840f-8d9f-45e0-9382-383ee6e8b606, infoPort=37565, infoSecurePort=0, ipcPort=32897, storageInfo=lv=-57;cid=testClusterID;nsid=813619597;c=1675861414556), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:35,010 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x332ba6c4a263d19: Processing first storage report for DS-c8647b0c-15e1-4642-bc40-5343ebf75278 from datanode 0ce6840f-8d9f-45e0-9382-383ee6e8b606 2023-02-08 13:03:35,010 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x332ba6c4a263d19: from storage DS-c8647b0c-15e1-4642-bc40-5343ebf75278 node DatanodeRegistration(127.0.0.1:41115, datanodeUuid=0ce6840f-8d9f-45e0-9382-383ee6e8b606, infoPort=37565, infoSecurePort=0, ipcPort=32897, storageInfo=lv=-57;cid=testClusterID;nsid=813619597;c=1675861414556), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:35,037 INFO [Listener at localhost/32897] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41033 2023-02-08 13:03:35,045 WARN [Listener at localhost/46361] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 13:03:35,144 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3faa45bb3d025439: Processing first storage report for DS-dfa85cc5-037d-4b51-ab64-58fe278c1ba3 from datanode c322a23c-d00b-4aeb-9b3c-af8c1b95d719 2023-02-08 13:03:35,144 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3faa45bb3d025439: from storage DS-dfa85cc5-037d-4b51-ab64-58fe278c1ba3 node DatanodeRegistration(127.0.0.1:45997, datanodeUuid=c322a23c-d00b-4aeb-9b3c-af8c1b95d719, infoPort=41399, infoSecurePort=0, ipcPort=46361, storageInfo=lv=-57;cid=testClusterID;nsid=813619597;c=1675861414556), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:35,144 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3faa45bb3d025439: Processing first storage report for DS-079d10ff-65e6-4124-9453-73918b02010a from datanode c322a23c-d00b-4aeb-9b3c-af8c1b95d719 2023-02-08 13:03:35,144 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3faa45bb3d025439: from storage DS-079d10ff-65e6-4124-9453-73918b02010a node DatanodeRegistration(127.0.0.1:45997, datanodeUuid=c322a23c-d00b-4aeb-9b3c-af8c1b95d719, infoPort=41399, infoSecurePort=0, ipcPort=46361, storageInfo=lv=-57;cid=testClusterID;nsid=813619597;c=1675861414556), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 13:03:35,154 DEBUG [Listener at localhost/46361] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50 2023-02-08 13:03:35,156 INFO [Listener at localhost/46361] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/cluster_be1edee7-869b-81ad-75dc-cda0e0ca5ce7/zookeeper_0, clientPort=50638, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/cluster_be1edee7-869b-81ad-75dc-cda0e0ca5ce7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/cluster_be1edee7-869b-81ad-75dc-cda0e0ca5ce7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 13:03:35,157 INFO [Listener at localhost/46361] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50638 2023-02-08 13:03:35,157 INFO [Listener at localhost/46361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:35,158 INFO [Listener at localhost/46361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:35,172 INFO [Listener at localhost/46361] util.FSUtils(479): Created version file at hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473 with version=8 2023-02-08 13:03:35,172 INFO [Listener at localhost/46361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:35,173 INFO [Listener at localhost/46361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:35,174 INFO [Listener at localhost/46361] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37591/user/jenkins/test-data/f85e6212-e9c2-dcd1-3fa1-e4e84daac073/hbase-staging 2023-02-08 13:03:35,176 INFO [Listener at localhost/46361] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:35,176 INFO [Listener at localhost/46361] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:35,176 INFO [Listener at localhost/46361] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:35,176 INFO [Listener at localhost/46361] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:35,176 INFO [Listener at localhost/46361] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:35,176 INFO [Listener at localhost/46361] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:35,176 INFO [Listener at localhost/46361] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:35,177 INFO [Listener at localhost/46361] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36381 2023-02-08 13:03:35,177 INFO [Listener at localhost/46361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:35,178 INFO [Listener at localhost/46361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:35,178 INFO [Listener at localhost/46361] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36381 connecting to ZooKeeper ensemble=127.0.0.1:50638 2023-02-08 13:03:35,185 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:363810x0, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:35,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36381-0x1003407beb90000 connected 2023-02-08 13:03:35,206 DEBUG [Listener at localhost/46361] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:35,206 DEBUG [Listener at localhost/46361] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:35,207 DEBUG [Listener at localhost/46361] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:35,207 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36381 2023-02-08 13:03:35,207 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36381 2023-02-08 13:03:35,210 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36381 2023-02-08 13:03:35,216 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36381 2023-02-08 13:03:35,216 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36381 2023-02-08 13:03:35,216 INFO [Listener at localhost/46361] master.HMaster(439): hbase.rootdir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473, hbase.cluster.distributed=false 2023-02-08 13:03:35,228 INFO [Listener at localhost/46361] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:35,228 INFO [Listener at localhost/46361] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:35,228 INFO [Listener at localhost/46361] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:35,229 INFO [Listener at localhost/46361] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:35,229 INFO [Listener at localhost/46361] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:35,229 INFO [Listener at localhost/46361] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:35,229 INFO [Listener at localhost/46361] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:35,230 INFO [Listener at localhost/46361] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44301 2023-02-08 13:03:35,230 INFO [Listener at localhost/46361] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:03:35,232 DEBUG [Listener at localhost/46361] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:35,233 INFO [Listener at localhost/46361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:35,233 INFO [Listener at localhost/46361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:35,234 INFO [Listener at localhost/46361] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44301 connecting to ZooKeeper ensemble=127.0.0.1:50638 2023-02-08 13:03:35,236 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:443010x0, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:35,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44301-0x1003407beb90001 connected 2023-02-08 13:03:35,238 DEBUG [Listener at localhost/46361] zookeeper.ZKUtil(164): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:35,239 DEBUG [Listener at localhost/46361] zookeeper.ZKUtil(164): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:35,240 DEBUG [Listener at localhost/46361] zookeeper.ZKUtil(164): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:35,244 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44301 2023-02-08 13:03:35,244 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44301 2023-02-08 13:03:35,244 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44301 2023-02-08 13:03:35,245 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44301 2023-02-08 13:03:35,248 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44301 2023-02-08 13:03:35,258 INFO [Listener at localhost/46361] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-08 13:03:35,259 INFO [Listener at localhost/46361] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:35,259 INFO [Listener at localhost/46361] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:35,259 INFO [Listener at localhost/46361] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 13:03:35,259 INFO [Listener at localhost/46361] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 13:03:35,259 INFO [Listener at localhost/46361] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 13:03:35,259 INFO [Listener at localhost/46361] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 13:03:35,260 INFO [Listener at localhost/46361] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39479 2023-02-08 13:03:35,260 INFO [Listener at localhost/46361] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 13:03:35,260 DEBUG [Listener at localhost/46361] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:35,261 INFO [Listener at localhost/46361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:35,262 INFO [Listener at localhost/46361] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:35,262 INFO [Listener at localhost/46361] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39479 connecting to ZooKeeper ensemble=127.0.0.1:50638 2023-02-08 13:03:35,264 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:394790x0, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 13:03:35,265 DEBUG [Listener at localhost/46361] zookeeper.ZKUtil(164): regionserver:394790x0, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:35,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39479-0x1003407beb90002 connected 2023-02-08 13:03:35,266 DEBUG [Listener at localhost/46361] zookeeper.ZKUtil(164): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:35,266 DEBUG [Listener at localhost/46361] zookeeper.ZKUtil(164): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 13:03:35,267 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39479 2023-02-08 13:03:35,267 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39479 2023-02-08 13:03:35,268 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39479 2023-02-08 13:03:35,270 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39479 2023-02-08 13:03:35,271 DEBUG [Listener at localhost/46361] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39479 2023-02-08 13:03:35,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36381,1675861415175 2023-02-08 13:03:35,274 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:03:35,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36381,1675861415175 2023-02-08 13:03:35,276 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:35,276 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:35,278 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:35,276 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:35,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:03:35,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36381,1675861415175 from backup master directory 2023-02-08 13:03:35,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 13:03:35,281 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36381,1675861415175 2023-02-08 13:03:35,281 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 13:03:35,281 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:35,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,36381,1675861415175 2023-02-08 13:03:35,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/hbase.id with ID: 345bde74-32e5-4865-9657-51391bb11bb4 2023-02-08 13:03:35,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 13:03:35,302 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:35,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4f33f849 to 127.0.0.1:50638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:35,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4533cef1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:35,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:35,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 13:03:35,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:35,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/MasterData/data/master/store-tmp 2023-02-08 13:03:35,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:35,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:03:35,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:35,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:35,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:03:35,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:35,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:35,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861415323Disabling compacts and flushes for region at 1675861415323Disabling writes for close at 1675861415324 (+1 ms)Writing region close event to WAL at 1675861415324Closed at 1675861415324 2023-02-08 13:03:35,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/MasterData/WALs/jenkins-hbase4.apache.org,36381,1675861415175 2023-02-08 13:03:35,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36381%2C1675861415175, suffix=, logDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/MasterData/WALs/jenkins-hbase4.apache.org,36381,1675861415175, archiveDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/MasterData/oldWALs, maxLogs=10 2023-02-08 13:03:35,338 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41115,DS-717ca5b1-251a-4fea-8818-4d4641009e9b,DISK] 2023-02-08 13:03:35,338 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45997,DS-dfa85cc5-037d-4b51-ab64-58fe278c1ba3,DISK] 2023-02-08 13:03:35,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/MasterData/WALs/jenkins-hbase4.apache.org,36381,1675861415175/jenkins-hbase4.apache.org%2C36381%2C1675861415175.1675861415326 2023-02-08 13:03:35,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41115,DS-717ca5b1-251a-4fea-8818-4d4641009e9b,DISK], DatanodeInfoWithStorage[127.0.0.1:45997,DS-dfa85cc5-037d-4b51-ab64-58fe278c1ba3,DISK]] 2023-02-08 13:03:35,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:35,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:35,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:35,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:35,341 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:35,342 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 13:03:35,343 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 13:03:35,343 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:35,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:35,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:35,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 13:03:35,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:35,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68892544, jitterRate=0.026578903198242188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:03:35,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675861415340Initializing all the Stores at 1675861415341 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861415341Cleaning up temporary data from old regions at 1675861415344 (+3 ms)Cleaning up detritus from prior splits at 1675861415344Region opened successfully at 1675861415349 (+5 ms) 2023-02-08 13:03:35,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 13:03:35,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 13:03:35,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 13:03:35,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 13:03:35,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-08 13:03:35,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-08 13:03:35,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 13:03:35,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 13:03:35,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 13:03:35,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 13:03:35,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 13:03:35,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 13:03:35,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 13:03:35,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 13:03:35,364 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:35,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 13:03:35,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 13:03:35,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 13:03:35,367 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:35,367 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:35,367 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:35,367 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:35,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,36381,1675861415175, sessionid=0x1003407beb90000, setting cluster-up flag (Was=false) 2023-02-08 13:03:35,373 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:35,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 13:03:35,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36381,1675861415175 2023-02-08 13:03:35,380 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:35,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 13:03:35,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36381,1675861415175 2023-02-08 13:03:35,385 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.hbase-snapshot/.tmp 2023-02-08 13:03:35,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:35,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:35,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:35,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:35,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-08 13:03:35,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-08 13:03:35,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:35,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675861445390 2023-02-08 13:03:35,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 13:03:35,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 13:03:35,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 13:03:35,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 13:03:35,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 13:03:35,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 13:03:35,391 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:35,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,391 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 13:03:35,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 13:03:35,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 13:03:35,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 13:03:35,393 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:35,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 13:03:35,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 13:03:35,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861415397,5,FailOnTimeoutGroup] 2023-02-08 13:03:35,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861415397,5,FailOnTimeoutGroup] 2023-02-08 13:03:35,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 13:03:35,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,406 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:35,406 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:35,407 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473 2023-02-08 13:03:35,412 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:35,416 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:03:35,417 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/info 2023-02-08 13:03:35,417 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:03:35,418 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:35,418 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:03:35,419 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:35,419 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:03:35,419 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:35,420 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:03:35,420 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/table 2023-02-08 13:03:35,421 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:03:35,421 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:35,421 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740 2023-02-08 13:03:35,422 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740 2023-02-08 13:03:35,423 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:03:35,424 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:03:35,425 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:35,425 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59327395, jitterRate=-0.11595292389392853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:03:35,425 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675861415412Initializing all the Stores at 1675861415412Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861415413 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861415416 (+3 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861415416Cleaning up temporary data from old regions at 1675861415422 (+6 ms)Cleaning up detritus from prior splits at 1675861415423 (+1 ms)Region opened successfully at 1675861415425 (+2 ms) 2023-02-08 13:03:35,425 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:03:35,425 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:03:35,426 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:03:35,426 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:03:35,426 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:03:35,426 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:35,426 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861415425Disabling compacts and flushes for region at 1675861415425Disabling writes for close at 1675861415426 (+1 ms)Writing region close event to WAL at 1675861415426Closed at 1675861415426 2023-02-08 13:03:35,426 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 13:03:35,426 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 13:03:35,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 13:03:35,430 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 13:03:35,431 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 13:03:35,473 INFO [RS:0;jenkins-hbase4:44301] regionserver.HRegionServer(952): ClusterId : 345bde74-32e5-4865-9657-51391bb11bb4 2023-02-08 13:03:35,473 INFO [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(952): ClusterId : 345bde74-32e5-4865-9657-51391bb11bb4 2023-02-08 13:03:35,473 DEBUG [RS:0;jenkins-hbase4:44301] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:03:35,473 DEBUG [RS:1;jenkins-hbase4:39479] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 13:03:35,475 DEBUG [RS:0;jenkins-hbase4:44301] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:03:35,475 DEBUG [RS:1;jenkins-hbase4:39479] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 13:03:35,475 DEBUG [RS:1;jenkins-hbase4:39479] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:03:35,475 DEBUG [RS:0;jenkins-hbase4:44301] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 13:03:35,477 DEBUG [RS:1;jenkins-hbase4:39479] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:03:35,478 DEBUG [RS:0;jenkins-hbase4:44301] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 13:03:35,478 DEBUG [RS:1;jenkins-hbase4:39479] zookeeper.ReadOnlyZKClient(139): Connect 0x3ceaccc6 to 127.0.0.1:50638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:35,479 DEBUG [RS:0;jenkins-hbase4:44301] zookeeper.ReadOnlyZKClient(139): Connect 0x7d0d6e70 to 127.0.0.1:50638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:35,482 DEBUG [RS:1;jenkins-hbase4:39479] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@322d252b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:35,482 DEBUG [RS:1;jenkins-hbase4:39479] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3612a7b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:35,484 DEBUG [RS:0;jenkins-hbase4:44301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73ca8fa1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:35,484 DEBUG [RS:0;jenkins-hbase4:44301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77f50500, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:35,491 DEBUG [RS:1;jenkins-hbase4:39479] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39479 2023-02-08 13:03:35,491 INFO [RS:1;jenkins-hbase4:39479] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:03:35,491 INFO [RS:1;jenkins-hbase4:39479] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:03:35,491 DEBUG [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:03:35,492 INFO [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36381,1675861415175 with isa=jenkins-hbase4.apache.org/172.31.14.131:39479, startcode=1675861415258 2023-02-08 13:03:35,492 DEBUG [RS:0;jenkins-hbase4:44301] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44301 2023-02-08 13:03:35,492 INFO [RS:0;jenkins-hbase4:44301] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 13:03:35,492 INFO [RS:0;jenkins-hbase4:44301] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 13:03:35,492 DEBUG [RS:0;jenkins-hbase4:44301] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 13:03:35,492 DEBUG [RS:1;jenkins-hbase4:39479] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:03:35,492 INFO [RS:0;jenkins-hbase4:44301] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36381,1675861415175 with isa=jenkins-hbase4.apache.org/172.31.14.131:44301, startcode=1675861415228 2023-02-08 13:03:35,492 DEBUG [RS:0;jenkins-hbase4:44301] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 13:03:35,493 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43369, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:03:35,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:35,495 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58957, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 13:03:35,496 DEBUG [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473 2023-02-08 13:03:35,496 DEBUG [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37591 2023-02-08 13:03:35,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:35,496 DEBUG [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:03:35,496 DEBUG [RS:0;jenkins-hbase4:44301] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473 2023-02-08 13:03:35,496 DEBUG [RS:0;jenkins-hbase4:44301] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37591 2023-02-08 13:03:35,496 DEBUG [RS:0;jenkins-hbase4:44301] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 13:03:35,497 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:35,500 DEBUG [RS:1;jenkins-hbase4:39479] zookeeper.ZKUtil(162): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:35,500 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39479,1675861415258] 2023-02-08 13:03:35,500 WARN [RS:1;jenkins-hbase4:39479] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:35,500 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44301,1675861415228] 2023-02-08 13:03:35,500 INFO [RS:1;jenkins-hbase4:39479] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:35,500 DEBUG [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/WALs/jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:35,502 DEBUG [RS:0;jenkins-hbase4:44301] zookeeper.ZKUtil(162): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:35,502 WARN [RS:0;jenkins-hbase4:44301] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 13:03:35,502 INFO [RS:0;jenkins-hbase4:44301] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:35,502 DEBUG [RS:0;jenkins-hbase4:44301] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/WALs/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:35,506 DEBUG [RS:1;jenkins-hbase4:39479] zookeeper.ZKUtil(162): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:35,507 DEBUG [RS:1;jenkins-hbase4:39479] zookeeper.ZKUtil(162): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:35,507 DEBUG [RS:0;jenkins-hbase4:44301] zookeeper.ZKUtil(162): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:35,507 DEBUG [RS:0;jenkins-hbase4:44301] zookeeper.ZKUtil(162): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:35,507 DEBUG [RS:1;jenkins-hbase4:39479] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:03:35,507 INFO [RS:1;jenkins-hbase4:39479] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:03:35,508 DEBUG [RS:0;jenkins-hbase4:44301] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 13:03:35,508 INFO [RS:0;jenkins-hbase4:44301] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 13:03:35,512 INFO [RS:1;jenkins-hbase4:39479] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:03:35,512 INFO [RS:0;jenkins-hbase4:44301] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 13:03:35,512 INFO [RS:1;jenkins-hbase4:39479] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:03:35,512 INFO [RS:0;jenkins-hbase4:44301] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 13:03:35,512 INFO [RS:1;jenkins-hbase4:39479] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,512 INFO [RS:0;jenkins-hbase4:44301] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,512 INFO [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:03:35,513 INFO [RS:0;jenkins-hbase4:44301] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 13:03:35,516 INFO [RS:1;jenkins-hbase4:39479] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,516 INFO [RS:0;jenkins-hbase4:44301] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,516 DEBUG [RS:1;jenkins-hbase4:39479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,516 DEBUG [RS:1;jenkins-hbase4:39479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,516 DEBUG [RS:0;jenkins-hbase4:44301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,516 DEBUG [RS:1;jenkins-hbase4:39479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:0;jenkins-hbase4:44301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:1;jenkins-hbase4:39479] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:0;jenkins-hbase4:44301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:1;jenkins-hbase4:39479] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:0;jenkins-hbase4:44301] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:1;jenkins-hbase4:39479] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:35,517 DEBUG [RS:0;jenkins-hbase4:44301] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:1;jenkins-hbase4:39479] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:0;jenkins-hbase4:44301] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-08 13:03:35,517 DEBUG [RS:1;jenkins-hbase4:39479] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:0;jenkins-hbase4:44301] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:1;jenkins-hbase4:39479] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:0;jenkins-hbase4:44301] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:1;jenkins-hbase4:39479] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:0;jenkins-hbase4:44301] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,517 DEBUG [RS:0;jenkins-hbase4:44301] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-08 13:03:35,520 INFO [RS:1;jenkins-hbase4:39479] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,520 INFO [RS:1;jenkins-hbase4:39479] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,520 INFO [RS:1;jenkins-hbase4:39479] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,520 INFO [RS:0;jenkins-hbase4:44301] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,520 INFO [RS:0;jenkins-hbase4:44301] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,520 INFO [RS:0;jenkins-hbase4:44301] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,531 INFO [RS:1;jenkins-hbase4:39479] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:03:35,531 INFO [RS:1;jenkins-hbase4:39479] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39479,1675861415258-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,533 INFO [RS:0;jenkins-hbase4:44301] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 13:03:35,533 INFO [RS:0;jenkins-hbase4:44301] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44301,1675861415228-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,543 INFO [RS:1;jenkins-hbase4:39479] regionserver.Replication(203): jenkins-hbase4.apache.org,39479,1675861415258 started 2023-02-08 13:03:35,543 INFO [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39479,1675861415258, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39479, sessionid=0x1003407beb90002 2023-02-08 13:03:35,543 INFO [RS:0;jenkins-hbase4:44301] regionserver.Replication(203): jenkins-hbase4.apache.org,44301,1675861415228 started 2023-02-08 13:03:35,543 DEBUG [RS:1;jenkins-hbase4:39479] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:03:35,543 INFO [RS:0;jenkins-hbase4:44301] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44301,1675861415228, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44301, sessionid=0x1003407beb90001 2023-02-08 13:03:35,543 DEBUG [RS:1;jenkins-hbase4:39479] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:35,543 DEBUG [RS:0;jenkins-hbase4:44301] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 13:03:35,543 DEBUG [RS:0;jenkins-hbase4:44301] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:35,543 DEBUG [RS:0;jenkins-hbase4:44301] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44301,1675861415228' 2023-02-08 13:03:35,543 DEBUG [RS:0;jenkins-hbase4:44301] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:35,543 DEBUG [RS:1;jenkins-hbase4:39479] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39479,1675861415258' 2023-02-08 13:03:35,543 DEBUG [RS:1;jenkins-hbase4:39479] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:35,544 DEBUG [RS:0;jenkins-hbase4:44301] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:35,544 DEBUG [RS:1;jenkins-hbase4:39479] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:35,544 DEBUG [RS:0;jenkins-hbase4:44301] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:03:35,544 DEBUG [RS:0;jenkins-hbase4:44301] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:03:35,544 DEBUG [RS:1;jenkins-hbase4:39479] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 13:03:35,544 DEBUG [RS:1;jenkins-hbase4:39479] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 13:03:35,544 DEBUG [RS:1;jenkins-hbase4:39479] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:35,544 DEBUG [RS:1;jenkins-hbase4:39479] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39479,1675861415258' 2023-02-08 13:03:35,544 DEBUG [RS:1;jenkins-hbase4:39479] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:35,544 DEBUG [RS:0;jenkins-hbase4:44301] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:35,544 DEBUG [RS:0;jenkins-hbase4:44301] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44301,1675861415228' 2023-02-08 13:03:35,544 DEBUG [RS:0;jenkins-hbase4:44301] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:35,544 DEBUG [RS:1;jenkins-hbase4:39479] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:35,544 DEBUG [RS:0;jenkins-hbase4:44301] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:35,545 DEBUG [RS:1;jenkins-hbase4:39479] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:03:35,545 INFO [RS:1;jenkins-hbase4:39479] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:03:35,545 INFO [RS:1;jenkins-hbase4:39479] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:03:35,545 DEBUG [RS:0;jenkins-hbase4:44301] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 13:03:35,545 INFO [RS:0;jenkins-hbase4:44301] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 13:03:35,545 INFO [RS:0;jenkins-hbase4:44301] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 13:03:35,582 DEBUG [jenkins-hbase4:36381] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-08 13:03:35,582 DEBUG [jenkins-hbase4:36381] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:35,583 DEBUG [jenkins-hbase4:36381] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:35,583 DEBUG [jenkins-hbase4:36381] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:35,583 DEBUG [jenkins-hbase4:36381] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:35,584 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39479,1675861415258, state=OPENING 2023-02-08 13:03:35,586 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 13:03:35,587 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:35,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39479,1675861415258}] 2023-02-08 13:03:35,587 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:03:35,742 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:35,742 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 13:03:35,744 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55190, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 13:03:35,747 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 13:03:35,747 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 13:03:35,748 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39479%2C1675861415258.meta, suffix=.meta, logDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/WALs/jenkins-hbase4.apache.org,39479,1675861415258, archiveDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/oldWALs, maxLogs=32 2023-02-08 13:03:35,763 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41115,DS-717ca5b1-251a-4fea-8818-4d4641009e9b,DISK] 2023-02-08 13:03:35,763 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45997,DS-dfa85cc5-037d-4b51-ab64-58fe278c1ba3,DISK] 2023-02-08 13:03:35,764 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/WALs/jenkins-hbase4.apache.org,39479,1675861415258/jenkins-hbase4.apache.org%2C39479%2C1675861415258.meta.1675861415749.meta 2023-02-08 13:03:35,766 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41115,DS-717ca5b1-251a-4fea-8818-4d4641009e9b,DISK], DatanodeInfoWithStorage[127.0.0.1:45997,DS-dfa85cc5-037d-4b51-ab64-58fe278c1ba3,DISK]] 2023-02-08 13:03:35,766 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:35,766 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 13:03:35,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 13:03:35,767 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 13:03:35,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 13:03:35,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:35,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 13:03:35,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 13:03:35,768 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 13:03:35,769 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/info 2023-02-08 13:03:35,769 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/info 2023-02-08 13:03:35,769 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 13:03:35,769 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:35,769 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 13:03:35,770 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:35,770 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/rep_barrier 2023-02-08 13:03:35,770 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 13:03:35,770 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:35,771 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 13:03:35,771 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/table 2023-02-08 13:03:35,771 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/table 2023-02-08 13:03:35,771 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 13:03:35,772 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:35,772 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740 2023-02-08 13:03:35,773 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740 2023-02-08 13:03:35,774 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 13:03:35,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 13:03:35,776 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72765168, jitterRate=0.08428549766540527}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 13:03:35,776 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675861415767Writing region info on filesystem at 1675861415767Initializing all the Stores at 1675861415768 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861415768Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861415768Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861415768Cleaning up temporary data from old regions at 1675861415774 (+6 ms)Cleaning up detritus from prior splits at 1675861415774Running coprocessor post-open hooks at 1675861415776 (+2 ms)Region opened successfully at 1675861415776 2023-02-08 13:03:35,776 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675861415742 2023-02-08 13:03:35,780 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 13:03:35,781 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 13:03:35,781 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39479,1675861415258, state=OPEN 2023-02-08 13:03:35,782 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 13:03:35,782 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 13:03:35,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 13:03:35,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39479,1675861415258 in 195 msec 2023-02-08 13:03:35,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 13:03:35,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-08 13:03:35,786 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 399 msec 2023-02-08 13:03:35,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675861415275, completionTime=-1 2023-02-08 13:03:35,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-08 13:03:35,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 13:03:35,791 DEBUG [hconnection-0x8283710-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:35,792 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55198, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:35,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-08 13:03:35,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675861475793 2023-02-08 13:03:35,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675861535793 2023-02-08 13:03:35,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-08 13:03:35,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36381,1675861415175-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36381,1675861415175-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36381,1675861415175-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36381, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 13:03:35,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 13:03:35,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:35,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 13:03:35,801 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 13:03:35,801 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:03:35,802 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:03:35,803 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/hbase/namespace/4410db37765722c77639da336cf2a4ea 2023-02-08 13:03:35,804 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/hbase/namespace/4410db37765722c77639da336cf2a4ea empty. 2023-02-08 13:03:35,804 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/hbase/namespace/4410db37765722c77639da336cf2a4ea 2023-02-08 13:03:35,804 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 13:03:35,814 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:35,815 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4410db37765722c77639da336cf2a4ea, NAME => 'hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp 2023-02-08 13:03:35,821 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:35,821 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4410db37765722c77639da336cf2a4ea, disabling compactions & flushes 2023-02-08 13:03:35,821 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. 2023-02-08 13:03:35,821 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. 2023-02-08 13:03:35,821 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. after waiting 0 ms 2023-02-08 13:03:35,821 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. 2023-02-08 13:03:35,821 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. 2023-02-08 13:03:35,821 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4410db37765722c77639da336cf2a4ea: Waiting for close lock at 1675861415821Disabling compacts and flushes for region at 1675861415821Disabling writes for close at 1675861415821Writing region close event to WAL at 1675861415821Closed at 1675861415821 2023-02-08 13:03:35,823 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:03:35,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861415823"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861415823"}]},"ts":"1675861415823"} 2023-02-08 13:03:35,825 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 13:03:35,825 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:03:35,825 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861415825"}]},"ts":"1675861415825"} 2023-02-08 13:03:35,826 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 13:03:35,829 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:35,829 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:35,829 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:35,829 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:35,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4410db37765722c77639da336cf2a4ea, ASSIGN}] 2023-02-08 13:03:35,831 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4410db37765722c77639da336cf2a4ea, ASSIGN 2023-02-08 13:03:35,831 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4410db37765722c77639da336cf2a4ea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39479,1675861415258; forceNewPlan=false, retain=false 2023-02-08 13:03:35,982 INFO [jenkins-hbase4:36381] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 13:03:35,982 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4410db37765722c77639da336cf2a4ea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:35,982 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861415982"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861415982"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861415982"}]},"ts":"1675861415982"} 2023-02-08 13:03:35,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4410db37765722c77639da336cf2a4ea, server=jenkins-hbase4.apache.org,39479,1675861415258}] 2023-02-08 13:03:36,138 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. 2023-02-08 13:03:36,139 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39479%2C1675861415258, suffix=, logDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/WALs/jenkins-hbase4.apache.org,39479,1675861415258, archiveDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/oldWALs, maxLogs=32 2023-02-08 13:03:36,152 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45997,DS-dfa85cc5-037d-4b51-ab64-58fe278c1ba3,DISK] 2023-02-08 13:03:36,153 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41115,DS-717ca5b1-251a-4fea-8818-4d4641009e9b,DISK] 2023-02-08 13:03:36,154 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/WALs/jenkins-hbase4.apache.org,39479,1675861415258/jenkins-hbase4.apache.org%2C39479%2C1675861415258.1675861416140 2023-02-08 13:03:36,154 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45997,DS-dfa85cc5-037d-4b51-ab64-58fe278c1ba3,DISK], DatanodeInfoWithStorage[127.0.0.1:41115,DS-717ca5b1-251a-4fea-8818-4d4641009e9b,DISK]] 2023-02-08 13:03:36,155 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4410db37765722c77639da336cf2a4ea, NAME => 'hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:36,155 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4410db37765722c77639da336cf2a4ea 2023-02-08 13:03:36,155 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:36,155 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4410db37765722c77639da336cf2a4ea 2023-02-08 13:03:36,155 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4410db37765722c77639da336cf2a4ea 2023-02-08 13:03:36,156 INFO [StoreOpener-4410db37765722c77639da336cf2a4ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4410db37765722c77639da336cf2a4ea 2023-02-08 13:03:36,157 DEBUG [StoreOpener-4410db37765722c77639da336cf2a4ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/namespace/4410db37765722c77639da336cf2a4ea/info 2023-02-08 13:03:36,157 DEBUG [StoreOpener-4410db37765722c77639da336cf2a4ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/namespace/4410db37765722c77639da336cf2a4ea/info 2023-02-08 13:03:36,157 INFO [StoreOpener-4410db37765722c77639da336cf2a4ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4410db37765722c77639da336cf2a4ea columnFamilyName info 2023-02-08 13:03:36,158 INFO [StoreOpener-4410db37765722c77639da336cf2a4ea-1] regionserver.HStore(310): Store=4410db37765722c77639da336cf2a4ea/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:36,158 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/namespace/4410db37765722c77639da336cf2a4ea 2023-02-08 13:03:36,159 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/namespace/4410db37765722c77639da336cf2a4ea 2023-02-08 13:03:36,160 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4410db37765722c77639da336cf2a4ea 2023-02-08 13:03:36,162 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/namespace/4410db37765722c77639da336cf2a4ea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:36,163 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4410db37765722c77639da336cf2a4ea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73575958, jitterRate=0.09636721014976501}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 13:03:36,163 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4410db37765722c77639da336cf2a4ea: Running coprocessor pre-open hook at 1675861416155Writing region info on filesystem at 1675861416155Initializing all the Stores at 1675861416156 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675861416156Cleaning up temporary data from old regions at 1675861416159 (+3 ms)Cleaning up detritus from prior splits at 1675861416159Running coprocessor post-open hooks at 1675861416163 (+4 ms)Region opened successfully at 1675861416163 2023-02-08 13:03:36,163 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea., pid=6, masterSystemTime=1675861416135 2023-02-08 13:03:36,165 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. 2023-02-08 13:03:36,165 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. 2023-02-08 13:03:36,165 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4410db37765722c77639da336cf2a4ea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:36,165 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675861416165"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861416165"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861416165"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861416165"}]},"ts":"1675861416165"} 2023-02-08 13:03:36,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 13:03:36,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4410db37765722c77639da336cf2a4ea, server=jenkins-hbase4.apache.org,39479,1675861415258 in 182 msec 2023-02-08 13:03:36,169 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 13:03:36,169 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4410db37765722c77639da336cf2a4ea, ASSIGN in 338 msec 2023-02-08 13:03:36,169 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:03:36,169 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861416169"}]},"ts":"1675861416169"} 2023-02-08 13:03:36,170 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 13:03:36,172 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:03:36,173 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 373 msec 2023-02-08 13:03:36,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 13:03:36,203 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:36,203 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:36,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 13:03:36,212 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:36,215 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-08 13:03:36,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 13:03:36,223 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 13:03:36,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-08 13:03:36,231 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 13:03:36,233 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 13:03:36,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.952sec 2023-02-08 13:03:36,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 13:03:36,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 13:03:36,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 13:03:36,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36381,1675861415175-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 13:03:36,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36381,1675861415175-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 13:03:36,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 13:03:36,273 DEBUG [Listener at localhost/46361] zookeeper.ReadOnlyZKClient(139): Connect 0x1837e29c to 127.0.0.1:50638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:36,276 DEBUG [Listener at localhost/46361] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69881ba5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:36,277 DEBUG [hconnection-0x6850a717-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:36,278 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55214, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:36,280 INFO [Listener at localhost/46361] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36381,1675861415175 2023-02-08 13:03:36,280 DEBUG [Listener at localhost/46361] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-08 13:03:36,280 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:36,280 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:36,283 DEBUG [Listener at localhost/46361] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 13:03:36,284 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55712, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 13:03:36,285 INFO [Listener at localhost/46361] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-08 13:03:36,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-08 13:03:36,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-08 13:03:36,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:55712 deadline: 1675861476285, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-08 13:03:36,285 INFO [Listener at localhost/46361] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-08 13:03:36,286 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:36,286 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:36,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 13:03:36,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-08 13:03:36,289 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 13:03:36,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-08 13:03:36,290 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:36,290 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:36,290 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 13:03:36,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:36,291 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:36,292 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a empty. 2023-02-08 13:03:36,292 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:36,292 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-08 13:03:36,300 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-08 13:03:36,301 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5ca5f4f7127dd227d80cd82b9945d91a, NAME => 'testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp 2023-02-08 13:03:36,308 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:36,308 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 5ca5f4f7127dd227d80cd82b9945d91a, disabling compactions & flushes 2023-02-08 13:03:36,308 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:36,308 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:36,308 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. after waiting 0 ms 2023-02-08 13:03:36,308 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:36,308 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:36,308 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 5ca5f4f7127dd227d80cd82b9945d91a: Waiting for close lock at 1675861416308Disabling compacts and flushes for region at 1675861416308Disabling writes for close at 1675861416308Writing region close event to WAL at 1675861416308Closed at 1675861416308 2023-02-08 13:03:36,310 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 13:03:36,311 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675861416310"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861416310"}]},"ts":"1675861416310"} 2023-02-08 13:03:36,312 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 13:03:36,312 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 13:03:36,312 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861416312"}]},"ts":"1675861416312"} 2023-02-08 13:03:36,313 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-08 13:03:36,316 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-08 13:03:36,316 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-08 13:03:36,316 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-08 13:03:36,316 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-08 13:03:36,317 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5ca5f4f7127dd227d80cd82b9945d91a, ASSIGN}] 2023-02-08 13:03:36,317 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5ca5f4f7127dd227d80cd82b9945d91a, ASSIGN 2023-02-08 13:03:36,318 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5ca5f4f7127dd227d80cd82b9945d91a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44301,1675861415228; forceNewPlan=false, retain=false 2023-02-08 13:03:36,391 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:36,391 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:36,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:36,468 INFO [jenkins-hbase4:36381] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-08 13:03:36,468 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5ca5f4f7127dd227d80cd82b9945d91a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:36,469 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675861416468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861416468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861416468"}]},"ts":"1675861416468"} 2023-02-08 13:03:36,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 5ca5f4f7127dd227d80cd82b9945d91a, server=jenkins-hbase4.apache.org,44301,1675861415228}] 2023-02-08 13:03:36,546 INFO [RS:0;jenkins-hbase4:44301] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44301%2C1675861415228, suffix=, logDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/WALs/jenkins-hbase4.apache.org,44301,1675861415228, archiveDir=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/oldWALs, maxLogs=32 2023-02-08 13:03:36,562 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41115,DS-717ca5b1-251a-4fea-8818-4d4641009e9b,DISK] 2023-02-08 13:03:36,562 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45997,DS-dfa85cc5-037d-4b51-ab64-58fe278c1ba3,DISK] 2023-02-08 13:03:36,563 INFO [RS:0;jenkins-hbase4:44301] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/WALs/jenkins-hbase4.apache.org,44301,1675861415228/jenkins-hbase4.apache.org%2C44301%2C1675861415228.1675861416547 2023-02-08 13:03:36,564 DEBUG [RS:0;jenkins-hbase4:44301] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41115,DS-717ca5b1-251a-4fea-8818-4d4641009e9b,DISK], DatanodeInfoWithStorage[127.0.0.1:45997,DS-dfa85cc5-037d-4b51-ab64-58fe278c1ba3,DISK]] 2023-02-08 13:03:36,593 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:36,593 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:36,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:36,623 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:36,623 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 13:03:36,625 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53738, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 13:03:36,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:36,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5ca5f4f7127dd227d80cd82b9945d91a, NAME => 'testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.', STARTKEY => '', ENDKEY => ''} 2023-02-08 13:03:36,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:36,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:36,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:36,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:36,629 INFO [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:36,631 DEBUG [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1 2023-02-08 13:03:36,631 DEBUG [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1 2023-02-08 13:03:36,631 INFO [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ca5f4f7127dd227d80cd82b9945d91a columnFamilyName f1 2023-02-08 13:03:36,631 INFO [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] regionserver.HStore(310): Store=5ca5f4f7127dd227d80cd82b9945d91a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:36,631 INFO [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:36,632 DEBUG [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2 2023-02-08 13:03:36,632 DEBUG [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2 2023-02-08 13:03:36,633 INFO [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ca5f4f7127dd227d80cd82b9945d91a columnFamilyName f2 2023-02-08 13:03:36,633 INFO [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] regionserver.HStore(310): Store=5ca5f4f7127dd227d80cd82b9945d91a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:36,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:36,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:36,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:36,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:36,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 13:03:36,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5ca5f4f7127dd227d80cd82b9945d91a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65459326, jitterRate=-0.024580031633377075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:36,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5ca5f4f7127dd227d80cd82b9945d91a: Running coprocessor pre-open hook at 1675861416628Writing region info on filesystem at 1675861416628Initializing all the Stores at 1675861416629 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861416629Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861416629Cleaning up temporary data from old regions at 1675861416634 (+5 ms)Cleaning up detritus from prior splits at 1675861416635 (+1 ms)Running coprocessor post-open hooks at 1675861416638 (+3 ms)Region opened successfully at 1675861416638 2023-02-08 13:03:36,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a., pid=12, masterSystemTime=1675861416623 2023-02-08 13:03:36,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:36,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:36,644 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5ca5f4f7127dd227d80cd82b9945d91a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:36,644 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675861416644"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675861416644"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675861416644"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675861416644"}]},"ts":"1675861416644"} 2023-02-08 13:03:36,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-08 13:03:36,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 5ca5f4f7127dd227d80cd82b9945d91a, server=jenkins-hbase4.apache.org,44301,1675861415228 in 176 msec 2023-02-08 13:03:36,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-08 13:03:36,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5ca5f4f7127dd227d80cd82b9945d91a, ASSIGN in 330 msec 2023-02-08 13:03:36,649 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 13:03:36,649 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861416649"}]},"ts":"1675861416649"} 2023-02-08 13:03:36,650 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-08 13:03:36,652 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 13:03:36,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 365 msec 2023-02-08 13:03:36,894 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:36,894 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:36,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-08 13:03:36,895 INFO [Listener at localhost/46361] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-08 13:03:36,896 DEBUG [Listener at localhost/46361] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-08 13:03:36,896 INFO [Listener at localhost/46361] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:03:36,897 INFO [Listener at localhost/46361] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-08 13:03:36,898 INFO [Listener at localhost/46361] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 13:03:36,898 INFO [Listener at localhost/46361] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-08 13:03:36,898 INFO [Listener at localhost/46361] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-08 13:03:36,909 DEBUG [hconnection-0x6850a717-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:36,920 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53752, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:36,927 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44301] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:37,008 INFO [Listener at localhost/46361] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-08 13:03:37,008 INFO [Listener at localhost/46361] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-08 13:03:37,008 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:37,008 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:37,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 13:03:37,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675861417009 (current time:1675861417009). 2023-02-08 13:03:37,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 13:03:37,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] zookeeper.ReadOnlyZKClient(139): Connect 0x09320f14 to 127.0.0.1:50638 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 13:03:37,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@601135cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 13:03:37,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 13:03:37,030 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55228, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 13:03:37,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09320f14 to 127.0.0.1:50638 2023-02-08 13:03:37,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:37,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 13:03:37,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 13:03:37,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 13:03:37,035 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 13:03:37,036 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675862017036 2023-02-08 13:03:37,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-08 13:03:37,036 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-08 13:03:37,038 DEBUG [Listener at localhost/46361] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-08 13:03:37,038 DEBUG [Listener at localhost/46361] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 13:03:37,038 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-08 13:03:37,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 13:03:37,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-08 13:03:37,040 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 13:03:37,040 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675862017040 2023-02-08 13:03:37,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-08 13:03:37,052 INFO [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-08 13:03:37,052 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:37,053 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-08 13:03:37,053 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-08 13:03:37,053 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,054 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 13:03:37,055 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,055 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:37,055 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:37,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:37,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:37,055 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,055 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:03:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 13:03:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 13:03:37,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-08 13:03:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 13:03:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-08 13:03:37,056 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-08 13:03:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 13:03:37,056 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-08 13:03:37,056 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-08 13:03:37,056 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-08 13:03:37,056 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:37,061 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-08 13:03:37,061 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-08 13:03:37,061 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-08 13:03:37,061 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44301,1675861415228' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-08 13:03:37,061 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-08 13:03:37,061 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 13:03:37,063 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-08 13:03:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-08 13:03:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39479,1675861415258' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-08 13:03:37,064 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-08 13:03:37,065 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,065 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 13:03:37,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:37,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:37,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:37,067 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 13:03:37,067 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:37,067 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 13:03:37,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:37,068 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 13:03:37,068 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:37,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-08 13:03:37,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:37,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44301,1675861415228' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-08 13:03:37,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3dbca054[Count = 0] remaining members to acquire global barrier 2023-02-08 13:03:37,070 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-08 13:03:37,070 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 13:03:37,071 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 13:03:37,071 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 13:03:37,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 13:03:37,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 13:03:37,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 13:03:37,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 13:03:37,071 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-08 13:03:37,071 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-08 13:03:37,071 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-08 13:03:37,071 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,071 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:03:37,071 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,39479,1675861415258' in zk 2023-02-08 13:03:37,071 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-08 13:03:37,072 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 13:03:37,072 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:37,072 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. started... 2023-02-08 13:03:37,072 INFO [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5ca5f4f7127dd227d80cd82b9945d91a 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-08 13:03:37,073 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-08 13:03:37,073 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:37,073 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-08 13:03:37,096 INFO [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/.tmp/f1/8369e09f189d41d5bbbd157ed790b240 2023-02-08 13:03:37,119 INFO [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/.tmp/f2/1c74d7c55f65450e8c168ca3a6df3202 2023-02-08 13:03:37,124 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/.tmp/f1/8369e09f189d41d5bbbd157ed790b240 as hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1/8369e09f189d41d5bbbd157ed790b240 2023-02-08 13:03:37,128 INFO [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1/8369e09f189d41d5bbbd157ed790b240, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 13:03:37,129 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/.tmp/f2/1c74d7c55f65450e8c168ca3a6df3202 as hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2/1c74d7c55f65450e8c168ca3a6df3202 2023-02-08 13:03:37,133 INFO [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2/1c74d7c55f65450e8c168ca3a6df3202, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-08 13:03:37,134 INFO [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 5ca5f4f7127dd227d80cd82b9945d91a in 62ms, sequenceid=5, compaction requested=false 2023-02-08 13:03:37,134 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5ca5f4f7127dd227d80cd82b9945d91a: 2023-02-08 13:03:37,135 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-08 13:03:37,135 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 13:03:37,135 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1/8369e09f189d41d5bbbd157ed790b240] hfiles 2023-02-08 13:03:37,135 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1/8369e09f189d41d5bbbd157ed790b240 for snapshot=testWithMapReduceSingleRegion 2023-02-08 13:03:37,135 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2/1c74d7c55f65450e8c168ca3a6df3202] hfiles 2023-02-08 13:03:37,135 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2/1c74d7c55f65450e8c168ca3a6df3202 for snapshot=testWithMapReduceSingleRegion 2023-02-08 13:03:37,138 DEBUG [Listener at localhost/46361] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:37,138 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:37,138 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:37,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 13:03:37,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-08 13:03:37,139 DEBUG [Listener at localhost/46361] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 13:03:37,150 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. completed. 2023-02-08 13:03:37,150 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:37,150 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-08 13:03:37,150 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-08 13:03:37,150 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,150 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-08 13:03:37,150 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44301,1675861415228' in zk 2023-02-08 13:03:37,153 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,153 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-08 13:03:37,153 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:37,153 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-08 13:03:37,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:37,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:37,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-08 13:03:37,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:37,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-08 13:03:37,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,44301,1675861415228': 2023-02-08 13:03:37,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44301,1675861415228' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-08 13:03:37,157 INFO [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-08 13:03:37,157 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:03:37,157 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:03:37,157 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-08 13:03:37,157 INFO [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 13:03:37,158 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,159 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,159 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,159 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 13:03:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,159 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:37,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:37,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:37,159 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:37,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:37,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:37,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,161 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-08 13:03:37,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:37,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-08 13:03:37,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,163 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,163 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:37,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-08 13:03:37,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,168 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,168 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:37,168 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 13:03:37,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:37,168 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,168 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:37,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:37,169 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 13:03:37,169 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 13:03:37,169 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-08 13:03:37,169 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,169 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 13:03:37,169 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,169 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-08 13:03:37,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-08 13:03:37,169 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-08 13:03:37,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:37,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:37,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 13:03:37,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 13:03:37,169 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:37,169 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-08 13:03:37,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 13:03:37,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 13:03:37,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-08 13:03:37,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion because node does not exist (not an error) 2023-02-08 13:03:37,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-08 13:03:37,229 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-08 13:03:37,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-08 13:03:37,230 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-08 13:03:37,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675861417036Consolidate snapshot: testWithMapReduceSingleRegion at 1675861417169 (+133 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1675861417169Writing data manifest for testWithMapReduceSingleRegion at 1675861417173 (+4 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1675861417187 (+14 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1675861417229 (+42 ms) 2023-02-08 13:03:37,231 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-08 13:03:37,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 194 msec 2023-02-08 13:03:37,340 DEBUG [Listener at localhost/46361] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 13:03:37,340 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:37,340 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:37,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-08 13:03:37,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 13:03:37,341 INFO [Listener at localhost/46361] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-08 13:03:37,341 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:37,341 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:37,345 INFO [Listener at localhost/46361] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-08 13:03:37,349 INFO [Listener at localhost/46361] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-08 13:03:37,376 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44301] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:37,455 INFO [Listener at localhost/46361] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-08 13:03:37,458 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:37,458 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:37,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-08 13:03:37,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-08 13:03:37,462 INFO [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-08 13:03:37,462 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:37,462 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-08 13:03:37,462 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-08 13:03:37,463 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,463 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:37,468 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:37,468 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:37,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:37,468 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:37,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:37,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:37,469 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,469 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 13:03:37,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:37,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:37,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:03:37,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:37,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 13:03:37,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:37,470 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-08 13:03:37,470 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-08 13:03:37,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-08 13:03:37,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-08 13:03:37,470 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-08 13:03:37,470 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:37,470 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-08 13:03:37,470 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-08 13:03:37,470 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-08 13:03:37,470 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39479,1675861415258' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-08 13:03:37,470 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 13:03:37,470 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-08 13:03:37,470 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 13:03:37,470 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 13:03:37,470 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:37,470 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. started... 2023-02-08 13:03:37,471 INFO [rs(jenkins-hbase4.apache.org,44301,1675861415228)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5ca5f4f7127dd227d80cd82b9945d91a 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-08 13:03:37,471 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:37,472 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:37,472 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:37,491 INFO [rs(jenkins-hbase4.apache.org,44301,1675861415228)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/.tmp/f1/819d00af1b644452b91ee1098ab3f4a0 2023-02-08 13:03:37,519 INFO [rs(jenkins-hbase4.apache.org,44301,1675861415228)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/.tmp/f2/c37517c2d46a468a84232e61e69de026 2023-02-08 13:03:37,524 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/.tmp/f1/819d00af1b644452b91ee1098ab3f4a0 as hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1/819d00af1b644452b91ee1098ab3f4a0 2023-02-08 13:03:37,528 INFO [rs(jenkins-hbase4.apache.org,44301,1675861415228)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1/819d00af1b644452b91ee1098ab3f4a0, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 13:03:37,529 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/.tmp/f2/c37517c2d46a468a84232e61e69de026 as hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2/c37517c2d46a468a84232e61e69de026 2023-02-08 13:03:37,533 INFO [rs(jenkins-hbase4.apache.org,44301,1675861415228)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2/c37517c2d46a468a84232e61e69de026, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-08 13:03:37,533 INFO [rs(jenkins-hbase4.apache.org,44301,1675861415228)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 5ca5f4f7127dd227d80cd82b9945d91a in 63ms, sequenceid=9, compaction requested=false 2023-02-08 13:03:37,533 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5ca5f4f7127dd227d80cd82b9945d91a: 2023-02-08 13:03:37,534 DEBUG [rs(jenkins-hbase4.apache.org,44301,1675861415228)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:37,534 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 13:03:37,534 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 13:03:37,534 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,534 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-08 13:03:37,534 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44301,1675861415228' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-08 13:03:37,535 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,535 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:37,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:37,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:37,536 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:37,536 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 13:03:37,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:37,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:37,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:37,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44301,1675861415228' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-08 13:03:37,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3983233b[Count = 0] remaining members to acquire global barrier 2023-02-08 13:03:37,538 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-08 13:03:37,538 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:37,539 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:37,539 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:37,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:37,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:37,539 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-08 13:03:37,539 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-08 13:03:37,539 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-08 13:03:37,539 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,39479,1675861415258' in zk 2023-02-08 13:03:37,539 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-08 13:03:37,539 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,539 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 13:03:37,539 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44301,1675861415228' in zk 2023-02-08 13:03:37,541 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-08 13:03:37,541 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:37,541 DEBUG [member: 'jenkins-hbase4.apache.org,39479,1675861415258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-08 13:03:37,542 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,542 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-08 13:03:37,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:37,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:37,542 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:37,542 DEBUG [member: 'jenkins-hbase4.apache.org,44301,1675861415228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-08 13:03:37,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:37,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:37,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44301,1675861415228': 2023-02-08 13:03:37,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44301,1675861415228' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-08 13:03:37,545 INFO [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-08 13:03:37,545 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 13:03:37,545 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 13:03:37,545 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-08 13:03:37,545 INFO [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 13:03:37,547 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,547 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:37,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,547 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 13:03:37,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 13:03:37,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:37,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 13:03:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,548 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:37,548 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 13:03:37,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:37,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,549 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 13:03:37,550 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-08 13:03:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,550 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,550 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:37,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:37,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,552 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,552 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:37,552 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:37,552 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,552 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 13:03:37,552 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:37,552 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 13:03:37,552 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-08 13:03:37,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-08 13:03:37,553 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:37,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-08 13:03:37,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 13:03:37,553 DEBUG [(jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 13:03:37,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:37,553 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:37,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 13:03:37,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:37,553 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:37,553 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-08 13:03:37,553 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-08 13:03:37,553 DEBUG [Listener at localhost/46361] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-08 13:03:37,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 13:03:37,553 DEBUG [Listener at localhost/46361] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 13:03:37,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:37,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:37,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 13:03:37,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 13:03:37,653 DEBUG [Listener at localhost/46361] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 13:03:37,654 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:37,654 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:37,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 13:03:37,741 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/hadoop-7363583223547241527.jar 2023-02-08 13:03:37,745 INFO [Listener at localhost/46361] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675861417009 type: FLUSH version: 2 ttl: 0 2023-02-08 13:03:37,745 DEBUG [Listener at localhost/46361] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37591/user/jenkins/test-data/f85e6212-e9c2-dcd1-3fa1-e4e84daac073/testWithMapReduceSingleRegion/bbd20a23-f0a2-4111-9239-d090b5260687/data/default/testWithMapReduce 2023-02-08 13:03:37,746 INFO [Listener at localhost/46361] snapshot.RestoreSnapshotHelper(239): region to add: 5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:37,746 INFO [Listener at localhost/46361] snapshot.RestoreSnapshotHelper(585): clone region=5ca5f4f7127dd227d80cd82b9945d91a as 5ca5f4f7127dd227d80cd82b9945d91a in snapshot testWithMapReduceSingleRegion 2023-02-08 13:03:37,746 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5ca5f4f7127dd227d80cd82b9945d91a, NAME => 'testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37591/user/jenkins/test-data/f85e6212-e9c2-dcd1-3fa1-e4e84daac073/testWithMapReduceSingleRegion/bbd20a23-f0a2-4111-9239-d090b5260687 2023-02-08 13:03:37,756 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:37,756 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8369e09f189d41d5bbbd157ed790b240 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-08 13:03:37,758 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1c74d7c55f65450e8c168ca3a6df3202 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-08 13:03:37,759 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 5ca5f4f7127dd227d80cd82b9945d91a, disabling compactions & flushes 2023-02-08 13:03:37,760 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:37,760 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:37,760 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. after waiting 0 ms 2023-02-08 13:03:37,760 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:37,760 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:37,760 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 5ca5f4f7127dd227d80cd82b9945d91a: Waiting for close lock at 1675861417759Disabling compacts and flushes for region at 1675861417759Disabling writes for close at 1675861417760 (+1 ms)Writing region close event to WAL at 1675861417760Closed at 1675861417760 2023-02-08 13:03:37,760 INFO [Listener at localhost/46361] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675861417009 type: FLUSH version: 2 ttl: 0 2023-02-08 13:03:37,760 DEBUG [Listener at localhost/46361] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:37591/user/jenkins/test-data/f85e6212-e9c2-dcd1-3fa1-e4e84daac073/testWithMapReduceSingleRegion/bbd20a23-f0a2-4111-9239-d090b5260687 2023-02-08 13:03:37,760 DEBUG [Listener at localhost/46361] util.CommonFSUtils(682): File system contents for path hdfs://localhost:37591/user/jenkins/test-data/f85e6212-e9c2-dcd1-3fa1-e4e84daac073/testWithMapReduceSingleRegion/bbd20a23-f0a2-4111-9239-d090b5260687 2023-02-08 13:03:37,761 DEBUG [Listener at localhost/46361] util.CommonFSUtils(699): |-data/ 2023-02-08 13:03:37,761 DEBUG [Listener at localhost/46361] util.CommonFSUtils(699): |----default/ 2023-02-08 13:03:37,761 DEBUG [Listener at localhost/46361] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-08 13:03:37,762 DEBUG [Listener at localhost/46361] util.CommonFSUtils(699): |----------5ca5f4f7127dd227d80cd82b9945d91a/ 2023-02-08 13:03:37,762 DEBUG [Listener at localhost/46361] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-08 13:03:37,762 DEBUG [Listener at localhost/46361] util.CommonFSUtils(699): |-------------f1/ 2023-02-08 13:03:37,763 DEBUG [Listener at localhost/46361] util.CommonFSUtils(702): |----------------testWithMapReduce=5ca5f4f7127dd227d80cd82b9945d91a-8369e09f189d41d5bbbd157ed790b240 2023-02-08 13:03:37,763 DEBUG [Listener at localhost/46361] util.CommonFSUtils(699): |-------------f2/ 2023-02-08 13:03:37,763 DEBUG [Listener at localhost/46361] util.CommonFSUtils(702): |----------------testWithMapReduce=5ca5f4f7127dd227d80cd82b9945d91a-1c74d7c55f65450e8c168ca3a6df3202 2023-02-08 13:03:37,763 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,764 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,764 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,765 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,765 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,765 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,765 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,832 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/hadoop-6289301878663063324.jar 2023-02-08 13:03:37,833 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,833 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,834 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,834 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,834 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,834 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,835 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-08 13:03:37,835 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-08 13:03:37,836 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-08 13:03:37,836 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-08 13:03:37,836 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-08 13:03:37,837 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-08 13:03:37,837 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-08 13:03:37,837 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-08 13:03:37,838 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-08 13:03:37,838 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-08 13:03:37,838 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-08 13:03:37,839 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 13:03:37,839 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 13:03:37,839 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-08 13:03:37,840 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-08 13:03:37,905 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/hadoop-1668725329438015320.jar 2023-02-08 13:03:37,906 DEBUG [Listener at localhost/46361] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-08 13:03:37,911 WARN [Listener at localhost/46361] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-08 13:03:37,946 INFO [Listener at localhost/46361] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-08 13:03:38,034 WARN [Listener at localhost/46361] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/mapreduce.cluster.local.dir/1675861417993/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-08 13:03:38,034 WARN [Listener at localhost/46361] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/mapreduce.cluster.local.dir/1675861417993/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-08 13:03:38,068 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 13:03:38,068 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-08 13:03:38,068 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 13:03:38,070 INFO [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:38,071 DEBUG [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/f85e6212-e9c2-dcd1-3fa1-e4e84daac073/testWithMapReduceSingleRegion/bbd20a23-f0a2-4111-9239-d090b5260687/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1 2023-02-08 13:03:38,071 INFO [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ca5f4f7127dd227d80cd82b9945d91a columnFamilyName f1 2023-02-08 13:03:38,076 DEBUG [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] regionserver.HStore(539): loaded hdfs://localhost:37591/user/jenkins/test-data/f85e6212-e9c2-dcd1-3fa1-e4e84daac073/testWithMapReduceSingleRegion/bbd20a23-f0a2-4111-9239-d090b5260687/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1/testWithMapReduce=5ca5f4f7127dd227d80cd82b9945d91a-8369e09f189d41d5bbbd157ed790b240 2023-02-08 13:03:38,076 INFO [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] regionserver.HStore(310): Store=5ca5f4f7127dd227d80cd82b9945d91a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:38,076 INFO [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:38,077 DEBUG [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37591/user/jenkins/test-data/f85e6212-e9c2-dcd1-3fa1-e4e84daac073/testWithMapReduceSingleRegion/bbd20a23-f0a2-4111-9239-d090b5260687/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2 2023-02-08 13:03:38,077 INFO [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ca5f4f7127dd227d80cd82b9945d91a columnFamilyName f2 2023-02-08 13:03:38,082 DEBUG [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] regionserver.HStore(539): loaded hdfs://localhost:37591/user/jenkins/test-data/f85e6212-e9c2-dcd1-3fa1-e4e84daac073/testWithMapReduceSingleRegion/bbd20a23-f0a2-4111-9239-d090b5260687/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2/testWithMapReduce=5ca5f4f7127dd227d80cd82b9945d91a-1c74d7c55f65450e8c168ca3a6df3202 2023-02-08 13:03:38,082 INFO [StoreOpener-5ca5f4f7127dd227d80cd82b9945d91a-1] regionserver.HStore(310): Store=5ca5f4f7127dd227d80cd82b9945d91a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 13:03:38,082 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 13:03:38,082 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5ca5f4f7127dd227d80cd82b9945d91a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60251884, jitterRate=-0.1021769642829895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 13:03:38,082 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5ca5f4f7127dd227d80cd82b9945d91a: Writing region info on filesystem at 1675861418069Initializing all the Stores at 1675861418069Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861418069Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675861418070 (+1 ms)Region opened successfully at 1675861418082 (+12 ms) 2023-02-08 13:03:38,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5ca5f4f7127dd227d80cd82b9945d91a, disabling compactions & flushes 2023-02-08 13:03:38,218 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:38,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:38,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. after waiting 0 ms 2023-02-08 13:03:38,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:38,219 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:38,219 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5ca5f4f7127dd227d80cd82b9945d91a: Waiting for close lock at 1675861418218Disabling compacts and flushes for region at 1675861418218Disabling writes for close at 1675861418218Writing region close event to WAL at 1675861418219 (+1 ms)Closed at 1675861418219 2023-02-08 13:03:39,071 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:39,071 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:39,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-08 13:03:39,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-08 13:03:39,075 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:39,075 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:39,075 INFO [Listener at localhost/46361] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-08 13:03:39,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-08 13:03:39,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-08 13:03:39,078 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:39,078 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:39,079 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861419078"}]},"ts":"1675861419078"} 2023-02-08 13:03:39,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 13:03:39,080 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-08 13:03:39,081 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-08 13:03:39,082 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5ca5f4f7127dd227d80cd82b9945d91a, UNASSIGN}] 2023-02-08 13:03:39,082 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5ca5f4f7127dd227d80cd82b9945d91a, UNASSIGN 2023-02-08 13:03:39,083 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5ca5f4f7127dd227d80cd82b9945d91a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:39,083 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675861419083"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675861419083"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675861419083"}]},"ts":"1675861419083"} 2023-02-08 13:03:39,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 5ca5f4f7127dd227d80cd82b9945d91a, server=jenkins-hbase4.apache.org,44301,1675861415228}] 2023-02-08 13:03:39,179 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:39,179 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:39,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 13:03:39,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:39,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5ca5f4f7127dd227d80cd82b9945d91a, disabling compactions & flushes 2023-02-08 13:03:39,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:39,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:39,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. after waiting 0 ms 2023-02-08 13:03:39,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:39,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-08 13:03:39,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a. 2023-02-08 13:03:39,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5ca5f4f7127dd227d80cd82b9945d91a: Waiting for close lock at 1675861419236Running coprocessor pre-close hooks at 1675861419236Disabling compacts and flushes for region at 1675861419236Disabling writes for close at 1675861419236Writing region close event to WAL at 1675861419237 (+1 ms)Running coprocessor post-close hooks at 1675861419240 (+3 ms)Closed at 1675861419241 (+1 ms) 2023-02-08 13:03:39,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:39,242 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5ca5f4f7127dd227d80cd82b9945d91a, regionState=CLOSED 2023-02-08 13:03:39,243 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675861419242"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675861419242"}]},"ts":"1675861419242"} 2023-02-08 13:03:39,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-08 13:03:39,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 5ca5f4f7127dd227d80cd82b9945d91a, server=jenkins-hbase4.apache.org,44301,1675861415228 in 160 msec 2023-02-08 13:03:39,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-08 13:03:39,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5ca5f4f7127dd227d80cd82b9945d91a, UNASSIGN in 163 msec 2023-02-08 13:03:39,247 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675861419247"}]},"ts":"1675861419247"} 2023-02-08 13:03:39,248 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-08 13:03:39,249 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-08 13:03:39,251 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 174 msec 2023-02-08 13:03:39,381 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:39,381 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:39,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-08 13:03:39,382 INFO [Listener at localhost/46361] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-08 13:03:39,382 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:39,382 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:39,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-08 13:03:39,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-08 13:03:39,385 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 13:03:39,385 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:39,385 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:39,386 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 13:03:39,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 13:03:39,388 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:39,390 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1, FileablePath, hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2, FileablePath, hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/recovered.edits] 2023-02-08 13:03:39,393 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1/819d00af1b644452b91ee1098ab3f4a0 to hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/archive/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1/819d00af1b644452b91ee1098ab3f4a0 2023-02-08 13:03:39,394 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1/8369e09f189d41d5bbbd157ed790b240 to hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/archive/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f1/8369e09f189d41d5bbbd157ed790b240 2023-02-08 13:03:39,396 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2/1c74d7c55f65450e8c168ca3a6df3202 to hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/archive/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2/1c74d7c55f65450e8c168ca3a6df3202 2023-02-08 13:03:39,396 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2/c37517c2d46a468a84232e61e69de026 to hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/archive/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/f2/c37517c2d46a468a84232e61e69de026 2023-02-08 13:03:39,398 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/recovered.edits/12.seqid to hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/archive/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a/recovered.edits/12.seqid 2023-02-08 13:03:39,399 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/.tmp/data/default/testWithMapReduce/5ca5f4f7127dd227d80cd82b9945d91a 2023-02-08 13:03:39,399 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-08 13:03:39,400 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 13:03:39,402 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-08 13:03:39,403 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-08 13:03:39,404 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 13:03:39,404 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-08 13:03:39,404 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675861419404"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:39,405 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-08 13:03:39,405 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5ca5f4f7127dd227d80cd82b9945d91a, NAME => 'testWithMapReduce,,1675861416287.5ca5f4f7127dd227d80cd82b9945d91a.', STARTKEY => '', ENDKEY => ''}] 2023-02-08 13:03:39,405 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-08 13:03:39,405 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675861419405"}]},"ts":"9223372036854775807"} 2023-02-08 13:03:39,406 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-08 13:03:39,408 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-08 13:03:39,408 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 25 msec 2023-02-08 13:03:39,486 INFO [Listener at localhost/46361] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 13:03:39,486 INFO [Listener at localhost/46361] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 13:03:39,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36381] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-08 13:03:39,488 INFO [Listener at localhost/46361] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-08 13:03:39,488 INFO [Listener at localhost/46361] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 13:03:39,488 INFO [Listener at localhost/46361] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 13:03:39,488 DEBUG [Listener at localhost/46361] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1837e29c to 127.0.0.1:50638 2023-02-08 13:03:39,488 DEBUG [Listener at localhost/46361] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:39,488 DEBUG [Listener at localhost/46361] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 13:03:39,488 DEBUG [Listener at localhost/46361] util.JVMClusterUtil(257): Found active master hash=811047674, stopped=false 2023-02-08 13:03:39,488 INFO [Listener at localhost/46361] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36381,1675861415175 2023-02-08 13:03:39,491 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:39,491 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:39,491 INFO [Listener at localhost/46361] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 13:03:39,491 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 13:03:39,491 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:39,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:39,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:39,494 DEBUG [Listener at localhost/46361] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f33f849 to 127.0.0.1:50638 2023-02-08 13:03:39,494 DEBUG [Listener at localhost/46361] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:39,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 13:03:39,494 INFO [Listener at localhost/46361] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44301,1675861415228' ***** 2023-02-08 13:03:39,494 INFO [Listener at localhost/46361] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:39,494 INFO [Listener at localhost/46361] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39479,1675861415258' ***** 2023-02-08 13:03:39,494 INFO [Listener at localhost/46361] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 13:03:39,494 INFO [RS:1;jenkins-hbase4:39479] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:39,494 INFO [RS:0;jenkins-hbase4:44301] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 13:03:39,494 INFO [RS:1;jenkins-hbase4:39479] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:39,495 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:39,495 INFO [RS:1;jenkins-hbase4:39479] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:39,495 INFO [RS:0;jenkins-hbase4:44301] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 13:03:39,496 INFO [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(3304): Received CLOSE for 4410db37765722c77639da336cf2a4ea 2023-02-08 13:03:39,496 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 13:03:39,496 INFO [RS:0;jenkins-hbase4:44301] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 13:03:39,496 INFO [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:39,496 INFO [RS:0;jenkins-hbase4:44301] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:39,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4410db37765722c77639da336cf2a4ea, disabling compactions & flushes 2023-02-08 13:03:39,497 DEBUG [RS:1;jenkins-hbase4:39479] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ceaccc6 to 127.0.0.1:50638 2023-02-08 13:03:39,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. 2023-02-08 13:03:39,497 DEBUG [RS:0;jenkins-hbase4:44301] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d0d6e70 to 127.0.0.1:50638 2023-02-08 13:03:39,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. 2023-02-08 13:03:39,497 DEBUG [RS:1;jenkins-hbase4:39479] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:39,498 INFO [RS:1;jenkins-hbase4:39479] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:39,498 INFO [RS:1;jenkins-hbase4:39479] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:39,498 INFO [RS:1;jenkins-hbase4:39479] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:39,498 INFO [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 13:03:39,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. after waiting 0 ms 2023-02-08 13:03:39,497 DEBUG [RS:0;jenkins-hbase4:44301] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:39,498 INFO [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-08 13:03:39,498 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 13:03:39,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. 2023-02-08 13:03:39,498 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 13:03:39,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4410db37765722c77639da336cf2a4ea 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-08 13:03:39,498 DEBUG [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 4410db37765722c77639da336cf2a4ea=hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea.} 2023-02-08 13:03:39,498 INFO [RS:0;jenkins-hbase4:44301] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44301,1675861415228; all regions closed. 2023-02-08 13:03:39,498 DEBUG [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(1505): Waiting on 1588230740, 4410db37765722c77639da336cf2a4ea 2023-02-08 13:03:39,498 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 13:03:39,498 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 13:03:39,498 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 13:03:39,498 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-08 13:03:39,502 DEBUG [RS:0;jenkins-hbase4:44301] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/oldWALs 2023-02-08 13:03:39,502 INFO [RS:0;jenkins-hbase4:44301] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44301%2C1675861415228:(num 1675861416547) 2023-02-08 13:03:39,502 DEBUG [RS:0;jenkins-hbase4:44301] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:39,502 INFO [RS:0;jenkins-hbase4:44301] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:39,502 INFO [RS:0;jenkins-hbase4:44301] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:39,503 INFO [RS:0;jenkins-hbase4:44301] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 13:03:39,503 INFO [RS:0;jenkins-hbase4:44301] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 13:03:39,503 INFO [RS:0;jenkins-hbase4:44301] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 13:03:39,503 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:39,504 INFO [RS:0;jenkins-hbase4:44301] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44301 2023-02-08 13:03:39,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/namespace/4410db37765722c77639da336cf2a4ea/.tmp/info/596c10dc71ec400abf404814447b5cb4 2023-02-08 13:03:39,511 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/.tmp/info/cbf1f418fc3f4bba9396b627fefc3f89 2023-02-08 13:03:39,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/namespace/4410db37765722c77639da336cf2a4ea/.tmp/info/596c10dc71ec400abf404814447b5cb4 as hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/namespace/4410db37765722c77639da336cf2a4ea/info/596c10dc71ec400abf404814447b5cb4 2023-02-08 13:03:39,515 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cbf1f418fc3f4bba9396b627fefc3f89 2023-02-08 13:03:39,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/namespace/4410db37765722c77639da336cf2a4ea/info/596c10dc71ec400abf404814447b5cb4, entries=2, sequenceid=6, filesize=4.8 K 2023-02-08 13:03:39,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4410db37765722c77639da336cf2a4ea in 21ms, sequenceid=6, compaction requested=false 2023-02-08 13:03:39,520 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-08 13:03:39,520 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-08 13:03:39,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/namespace/4410db37765722c77639da336cf2a4ea/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-08 13:03:39,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. 2023-02-08 13:03:39,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4410db37765722c77639da336cf2a4ea: Waiting for close lock at 1675861419497Running coprocessor pre-close hooks at 1675861419497Disabling compacts and flushes for region at 1675861419497Disabling writes for close at 1675861419498 (+1 ms)Obtaining lock to block concurrent updates at 1675861419498Preparing flush snapshotting stores in 4410db37765722c77639da336cf2a4ea at 1675861419498Finished memstore snapshotting hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675861419498Flushing stores of hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. at 1675861419499 (+1 ms)Flushing 4410db37765722c77639da336cf2a4ea/info: creating writer at 1675861419499Flushing 4410db37765722c77639da336cf2a4ea/info: appending metadata at 1675861419501 (+2 ms)Flushing 4410db37765722c77639da336cf2a4ea/info: closing flushed file at 1675861419502 (+1 ms)Flushing 4410db37765722c77639da336cf2a4ea/info: reopening flushed file at 1675861419515 (+13 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4410db37765722c77639da336cf2a4ea in 21ms, sequenceid=6, compaction requested=false at 1675861419519 (+4 ms)Writing region close event to WAL at 1675861419519Running coprocessor post-close hooks at 1675861419523 (+4 ms)Closed at 1675861419524 (+1 ms) 2023-02-08 13:03:39,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675861415799.4410db37765722c77639da336cf2a4ea. 2023-02-08 13:03:39,525 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/.tmp/rep_barrier/5eb3b12717164d7abb2ea38897b8fa6b 2023-02-08 13:03:39,528 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5eb3b12717164d7abb2ea38897b8fa6b 2023-02-08 13:03:39,534 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/.tmp/table/8fa92f99751e4ce79a9c53fa1f17bb2e 2023-02-08 13:03:39,538 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fa92f99751e4ce79a9c53fa1f17bb2e 2023-02-08 13:03:39,538 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/.tmp/info/cbf1f418fc3f4bba9396b627fefc3f89 as hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/info/cbf1f418fc3f4bba9396b627fefc3f89 2023-02-08 13:03:39,540 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:39,540 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:39,543 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cbf1f418fc3f4bba9396b627fefc3f89 2023-02-08 13:03:39,543 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/info/cbf1f418fc3f4bba9396b627fefc3f89, entries=12, sequenceid=21, filesize=6.2 K 2023-02-08 13:03:39,544 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/.tmp/rep_barrier/5eb3b12717164d7abb2ea38897b8fa6b as hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/rep_barrier/5eb3b12717164d7abb2ea38897b8fa6b 2023-02-08 13:03:39,547 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5eb3b12717164d7abb2ea38897b8fa6b 2023-02-08 13:03:39,547 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/rep_barrier/5eb3b12717164d7abb2ea38897b8fa6b, entries=1, sequenceid=21, filesize=5.0 K 2023-02-08 13:03:39,547 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/.tmp/table/8fa92f99751e4ce79a9c53fa1f17bb2e as hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/table/8fa92f99751e4ce79a9c53fa1f17bb2e 2023-02-08 13:03:39,550 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fa92f99751e4ce79a9c53fa1f17bb2e 2023-02-08 13:03:39,550 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/table/8fa92f99751e4ce79a9c53fa1f17bb2e, entries=4, sequenceid=21, filesize=5.0 K 2023-02-08 13:03:39,551 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=21, compaction requested=false 2023-02-08 13:03:39,554 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-08 13:03:39,554 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 13:03:39,555 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:39,555 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675861419498Running coprocessor pre-close hooks at 1675861419498Disabling compacts and flushes for region at 1675861419498Disabling writes for close at 1675861419498Obtaining lock to block concurrent updates at 1675861419498Preparing flush snapshotting stores in 1588230740 at 1675861419498Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1675861419499 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675861419499Flushing 1588230740/info: creating writer at 1675861419499Flushing 1588230740/info: appending metadata at 1675861419506 (+7 ms)Flushing 1588230740/info: closing flushed file at 1675861419506Flushing 1588230740/rep_barrier: creating writer at 1675861419516 (+10 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675861419517 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675861419517Flushing 1588230740/table: creating writer at 1675861419528 (+11 ms)Flushing 1588230740/table: appending metadata at 1675861419530 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675861419530Flushing 1588230740/info: reopening flushed file at 1675861419539 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675861419544 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675861419548 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=21, compaction requested=false at 1675861419551 (+3 ms)Writing region close event to WAL at 1675861419552 (+1 ms)Running coprocessor post-close hooks at 1675861419554 (+2 ms)Closed at 1675861419555 (+1 ms) 2023-02-08 13:03:39,555 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 13:03:39,601 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:39,601 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:39,601 ERROR [Listener at localhost/46361-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43360cbc rejected from java.util.concurrent.ThreadPoolExecutor@47098002[Shutting down, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:39,602 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:39,601 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44301,1675861415228 2023-02-08 13:03:39,602 ERROR [Listener at localhost/46361-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40e3d7cf rejected from java.util.concurrent.ThreadPoolExecutor@47098002[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:39,602 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:39,698 INFO [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39479,1675861415258; all regions closed. 2023-02-08 13:03:39,699 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44301,1675861415228] 2023-02-08 13:03:39,699 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44301,1675861415228; numProcessing=1 2023-02-08 13:03:39,701 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44301,1675861415228 already deleted, retry=false 2023-02-08 13:03:39,701 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44301,1675861415228 expired; onlineServers=1 2023-02-08 13:03:39,702 DEBUG [RS:1;jenkins-hbase4:39479] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/oldWALs 2023-02-08 13:03:39,702 INFO [RS:1;jenkins-hbase4:39479] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39479%2C1675861415258.meta:.meta(num 1675861415749) 2023-02-08 13:03:39,705 DEBUG [RS:1;jenkins-hbase4:39479] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/oldWALs 2023-02-08 13:03:39,706 INFO [RS:1;jenkins-hbase4:39479] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39479%2C1675861415258:(num 1675861416140) 2023-02-08 13:03:39,706 DEBUG [RS:1;jenkins-hbase4:39479] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:39,706 INFO [RS:1;jenkins-hbase4:39479] regionserver.LeaseManager(133): Closed leases 2023-02-08 13:03:39,706 INFO [RS:1;jenkins-hbase4:39479] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-08 13:03:39,706 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:39,708 INFO [RS:1;jenkins-hbase4:39479] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39479 2023-02-08 13:03:39,710 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39479,1675861415258 2023-02-08 13:03:39,710 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 13:03:39,710 ERROR [Listener at localhost/46361-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4bf24383 rejected from java.util.concurrent.ThreadPoolExecutor@4fcdde25[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:39,711 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39479,1675861415258] 2023-02-08 13:03:39,711 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39479,1675861415258; numProcessing=2 2023-02-08 13:03:39,712 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39479,1675861415258 already deleted, retry=false 2023-02-08 13:03:39,712 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39479,1675861415258 expired; onlineServers=0 2023-02-08 13:03:39,712 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36381,1675861415175' ***** 2023-02-08 13:03:39,712 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 13:03:39,713 DEBUG [M:0;jenkins-hbase4:36381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34681828, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-08 13:03:39,713 INFO [M:0;jenkins-hbase4:36381] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36381,1675861415175 2023-02-08 13:03:39,713 INFO [M:0;jenkins-hbase4:36381] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36381,1675861415175; all regions closed. 2023-02-08 13:03:39,713 DEBUG [M:0;jenkins-hbase4:36381] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 13:03:39,713 DEBUG [M:0;jenkins-hbase4:36381] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 13:03:39,714 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 13:03:39,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861415397] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675861415397,5,FailOnTimeoutGroup] 2023-02-08 13:03:39,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861415397] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675861415397,5,FailOnTimeoutGroup] 2023-02-08 13:03:39,714 DEBUG [M:0;jenkins-hbase4:36381] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 13:03:39,715 INFO [M:0;jenkins-hbase4:36381] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 13:03:39,715 INFO [M:0;jenkins-hbase4:36381] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 13:03:39,715 INFO [M:0;jenkins-hbase4:36381] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-08 13:03:39,715 DEBUG [M:0;jenkins-hbase4:36381] master.HMaster(1502): Stopping service threads 2023-02-08 13:03:39,715 INFO [M:0;jenkins-hbase4:36381] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 13:03:39,715 ERROR [M:0;jenkins-hbase4:36381] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-08 13:03:39,716 INFO [M:0;jenkins-hbase4:36381] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 13:03:39,716 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 13:03:39,716 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 13:03:39,716 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 13:03:39,716 DEBUG [M:0;jenkins-hbase4:36381] zookeeper.ZKUtil(398): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 13:03:39,716 WARN [M:0;jenkins-hbase4:36381] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 13:03:39,716 INFO [M:0;jenkins-hbase4:36381] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 13:03:39,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 13:03:39,717 INFO [M:0;jenkins-hbase4:36381] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 13:03:39,717 DEBUG [M:0;jenkins-hbase4:36381] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 13:03:39,717 INFO [M:0;jenkins-hbase4:36381] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:39,717 DEBUG [M:0;jenkins-hbase4:36381] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:39,717 DEBUG [M:0;jenkins-hbase4:36381] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 13:03:39,717 DEBUG [M:0;jenkins-hbase4:36381] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:39,717 INFO [M:0;jenkins-hbase4:36381] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.67 KB heapSize=65.66 KB 2023-02-08 13:03:39,724 INFO [M:0;jenkins-hbase4:36381] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/27e489373b1c417497258709dc4582cd 2023-02-08 13:03:39,729 DEBUG [M:0;jenkins-hbase4:36381] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/27e489373b1c417497258709dc4582cd as hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/27e489373b1c417497258709dc4582cd 2023-02-08 13:03:39,733 INFO [M:0;jenkins-hbase4:36381] regionserver.HStore(1080): Added hdfs://localhost:37591/user/jenkins/test-data/820f84df-7a06-f563-b7ef-9c51cc2d7473/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/27e489373b1c417497258709dc4582cd, entries=17, sequenceid=132, filesize=8.6 K 2023-02-08 13:03:39,733 INFO [M:0;jenkins-hbase4:36381] regionserver.HRegion(2947): Finished flush of dataSize ~54.67 KB/55986, heapSize ~65.64 KB/67216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-08 13:03:39,734 INFO [M:0;jenkins-hbase4:36381] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 13:03:39,734 DEBUG [M:0;jenkins-hbase4:36381] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675861419717Disabling compacts and flushes for region at 1675861419717Disabling writes for close at 1675861419717Obtaining lock to block concurrent updates at 1675861419717Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675861419717Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=55986, getHeapSize=67216, getOffHeapSize=0, getCellsCount=145 at 1675861419717Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675861419718 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675861419718Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675861419720 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675861419720Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675861419729 (+9 ms)Finished flush of dataSize ~54.67 KB/55986, heapSize ~65.64 KB/67216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1675861419733 (+4 ms)Writing region close event to WAL at 1675861419734 (+1 ms)Closed at 1675861419734 2023-02-08 13:03:39,736 INFO [M:0;jenkins-hbase4:36381] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 13:03:39,736 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 13:03:39,736 INFO [M:0;jenkins-hbase4:36381] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36381 2023-02-08 13:03:39,737 DEBUG [M:0;jenkins-hbase4:36381] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36381,1675861415175 already deleted, retry=false 2023-02-08 13:03:39,800 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:39,801 INFO [RS:0;jenkins-hbase4:44301] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44301,1675861415228; zookeeper connection closed. 2023-02-08 13:03:39,801 ERROR [Listener at localhost/46361-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3841ef79 rejected from java.util.concurrent.ThreadPoolExecutor@47098002[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:39,801 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:44301-0x1003407beb90001, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:39,801 ERROR [Listener at localhost/46361-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c2717ec rejected from java.util.concurrent.ThreadPoolExecutor@47098002[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:39,801 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5687b11] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5687b11 2023-02-08 13:03:39,901 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:39,901 INFO [M:0;jenkins-hbase4:36381] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36381,1675861415175; zookeeper connection closed. 2023-02-08 13:03:39,901 ERROR [Listener at localhost/46361-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3281c237 rejected from java.util.concurrent.ThreadPoolExecutor@36be50bf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:39,902 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): master:36381-0x1003407beb90000, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:39,902 ERROR [Listener at localhost/46361-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e290df7 rejected from java.util.concurrent.ThreadPoolExecutor@36be50bf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:40,001 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:40,001 INFO [RS:1;jenkins-hbase4:39479] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39479,1675861415258; zookeeper connection closed. 2023-02-08 13:03:40,001 ERROR [Listener at localhost/46361-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@62b8daa9 rejected from java.util.concurrent.ThreadPoolExecutor@4fcdde25[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:40,001 DEBUG [Listener at localhost/46361-EventThread] zookeeper.ZKWatcher(600): regionserver:39479-0x1003407beb90002, quorum=127.0.0.1:50638, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 13:03:40,001 ERROR [Listener at localhost/46361-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a92ae94 rejected from java.util.concurrent.ThreadPoolExecutor@4fcdde25[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 13:03:40,001 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6f7e2a4d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6f7e2a4d 2023-02-08 13:03:40,002 INFO [Listener at localhost/46361] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-08 13:03:40,002 WARN [Listener at localhost/46361] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:40,006 INFO [Listener at localhost/46361] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:40,107 WARN [BP-1210809060-172.31.14.131-1675861414556 heartbeating to localhost/127.0.0.1:37591] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:40,107 WARN [BP-1210809060-172.31.14.131-1675861414556 heartbeating to localhost/127.0.0.1:37591] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1210809060-172.31.14.131-1675861414556 (Datanode Uuid c322a23c-d00b-4aeb-9b3c-af8c1b95d719) service to localhost/127.0.0.1:37591 2023-02-08 13:03:40,108 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/cluster_be1edee7-869b-81ad-75dc-cda0e0ca5ce7/dfs/data/data3/current/BP-1210809060-172.31.14.131-1675861414556] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:40,108 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/cluster_be1edee7-869b-81ad-75dc-cda0e0ca5ce7/dfs/data/data4/current/BP-1210809060-172.31.14.131-1675861414556] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:40,110 WARN [Listener at localhost/46361] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 13:03:40,113 INFO [Listener at localhost/46361] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:40,216 WARN [BP-1210809060-172.31.14.131-1675861414556 heartbeating to localhost/127.0.0.1:37591] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 13:03:40,216 WARN [BP-1210809060-172.31.14.131-1675861414556 heartbeating to localhost/127.0.0.1:37591] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1210809060-172.31.14.131-1675861414556 (Datanode Uuid 0ce6840f-8d9f-45e0-9382-383ee6e8b606) service to localhost/127.0.0.1:37591 2023-02-08 13:03:40,217 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/cluster_be1edee7-869b-81ad-75dc-cda0e0ca5ce7/dfs/data/data1/current/BP-1210809060-172.31.14.131-1675861414556] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:40,217 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/282bfabf-4a21-d852-3a69-9390b7800e50/cluster_be1edee7-869b-81ad-75dc-cda0e0ca5ce7/dfs/data/data2/current/BP-1210809060-172.31.14.131-1675861414556] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 13:03:40,230 INFO [Listener at localhost/46361] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 13:03:40,342 INFO [Listener at localhost/46361] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 13:03:40,363 INFO [Listener at localhost/46361] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-08 13:03:40,375 INFO [Listener at localhost/46361] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=293 (was 274) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46361 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:37591 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:37591 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:37591 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36381,1675861415175)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:37591 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37591 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:37591 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:37591 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=597 (was 580) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=294 (was 302), ProcessCount=165 (was 165), AvailableMemoryMB=3741 (was 3824)