2023-02-15 23:00:57,248 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-15 23:00:57,291 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=164, ProcessCount=166, AvailableMemoryMB=4111 2023-02-15 23:00:57,548 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95 2023-02-15 23:00:57,555 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 23:00:57,555 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/cluster_f3071d38-6cf6-3266-107c-0e88be1a688a, deleteOnExit=true 2023-02-15 23:00:57,556 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 23:00:57,556 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/test.cache.data in system properties and HBase conf 2023-02-15 23:00:57,557 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 23:00:57,557 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/hadoop.log.dir in system properties and HBase conf 2023-02-15 23:00:57,557 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 23:00:57,558 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 23:00:57,558 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 23:00:57,654 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-15 23:00:58,006 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 23:00:58,012 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:00:58,012 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:00:58,013 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 23:00:58,013 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:00:58,013 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 23:00:58,014 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 23:00:58,014 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:00:58,015 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:00:58,015 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 23:00:58,016 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/nfs.dump.dir in system properties and HBase conf 2023-02-15 23:00:58,016 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/java.io.tmpdir in system properties and HBase conf 2023-02-15 23:00:58,016 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:00:58,016 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 23:00:58,017 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 23:00:58,515 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:00:58,520 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:00:58,792 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-15 23:00:58,940 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-15 23:00:58,953 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:00:58,996 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:00:59,030 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/java.io.tmpdir/Jetty_localhost_43551_hdfs____.1pnr1g/webapp 2023-02-15 23:00:59,174 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43551 2023-02-15 23:00:59,186 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:00:59,186 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:00:59,696 WARN [Listener at localhost/41805] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:00:59,775 WARN [Listener at localhost/41805] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:00:59,798 WARN [Listener at localhost/41805] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:00:59,805 INFO [Listener at localhost/41805] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:00:59,814 INFO [Listener at localhost/41805] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/java.io.tmpdir/Jetty_localhost_42453_datanode____.vet6kl/webapp 2023-02-15 23:00:59,943 INFO [Listener at localhost/41805] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42453 2023-02-15 23:01:00,371 WARN [Listener at localhost/33777] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:00,387 WARN [Listener at localhost/33777] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:01:00,393 WARN [Listener at localhost/33777] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:00,395 INFO [Listener at localhost/33777] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:00,402 INFO [Listener at localhost/33777] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/java.io.tmpdir/Jetty_localhost_35611_datanode____dw22aj/webapp 2023-02-15 23:01:00,517 INFO [Listener at localhost/33777] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35611 2023-02-15 23:01:00,532 WARN [Listener at localhost/40123] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:00,868 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x59af27f2a3fe4021: Processing first storage report for DS-5f9da598-b847-4b10-9e55-b8593afb23fb from datanode a153abda-ff9a-4abc-8779-c170c97e2577 2023-02-15 23:01:00,870 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x59af27f2a3fe4021: from storage DS-5f9da598-b847-4b10-9e55-b8593afb23fb node DatanodeRegistration(127.0.0.1:45649, datanodeUuid=a153abda-ff9a-4abc-8779-c170c97e2577, infoPort=33637, infoSecurePort=0, ipcPort=33777, storageInfo=lv=-57;cid=testClusterID;nsid=1028476359;c=1676502058586), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-15 23:01:00,871 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x59af27f2a3fe4021: Processing first storage report for DS-d2e31c1a-9b14-41b4-b442-8cd6792cfc72 from datanode a153abda-ff9a-4abc-8779-c170c97e2577 2023-02-15 23:01:00,871 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x59af27f2a3fe4021: from storage DS-d2e31c1a-9b14-41b4-b442-8cd6792cfc72 node DatanodeRegistration(127.0.0.1:45649, datanodeUuid=a153abda-ff9a-4abc-8779-c170c97e2577, infoPort=33637, infoSecurePort=0, ipcPort=33777, storageInfo=lv=-57;cid=testClusterID;nsid=1028476359;c=1676502058586), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 23:01:00,880 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc776dadce7f46b35: Processing first storage report for DS-8beed69b-6049-45b8-86df-69b4153512b3 from datanode cb0fa7e7-8280-41f0-90ea-499ffad08141 2023-02-15 23:01:00,880 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc776dadce7f46b35: from storage DS-8beed69b-6049-45b8-86df-69b4153512b3 node DatanodeRegistration(127.0.0.1:38887, datanodeUuid=cb0fa7e7-8280-41f0-90ea-499ffad08141, infoPort=38471, infoSecurePort=0, ipcPort=40123, storageInfo=lv=-57;cid=testClusterID;nsid=1028476359;c=1676502058586), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:00,880 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc776dadce7f46b35: Processing first storage report for DS-62901c3e-6d4c-4981-b527-a0d9c8691913 from datanode cb0fa7e7-8280-41f0-90ea-499ffad08141 2023-02-15 23:01:00,880 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc776dadce7f46b35: from storage DS-62901c3e-6d4c-4981-b527-a0d9c8691913 node DatanodeRegistration(127.0.0.1:38887, datanodeUuid=cb0fa7e7-8280-41f0-90ea-499ffad08141, infoPort=38471, infoSecurePort=0, ipcPort=40123, storageInfo=lv=-57;cid=testClusterID;nsid=1028476359;c=1676502058586), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:01,001 DEBUG [Listener at localhost/40123] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95 2023-02-15 23:01:01,087 INFO [Listener at localhost/40123] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/cluster_f3071d38-6cf6-3266-107c-0e88be1a688a/zookeeper_0, clientPort=64794, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/cluster_f3071d38-6cf6-3266-107c-0e88be1a688a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/cluster_f3071d38-6cf6-3266-107c-0e88be1a688a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 23:01:01,106 INFO [Listener at localhost/40123] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64794 2023-02-15 23:01:01,118 INFO [Listener at localhost/40123] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:01,121 INFO [Listener at localhost/40123] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:01,805 INFO [Listener at localhost/40123] util.FSUtils(479): Created version file at hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964 with version=8 2023-02-15 23:01:01,806 INFO [Listener at localhost/40123] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:01,808 INFO [Listener at localhost/40123] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:01,811 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/hbase-staging 2023-02-15 23:01:02,147 INFO [Listener at localhost/40123] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-15 23:01:02,661 INFO [Listener at localhost/40123] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:02,693 INFO [Listener at localhost/40123] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:02,694 INFO [Listener at localhost/40123] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:02,694 INFO [Listener at localhost/40123] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:02,694 INFO [Listener at localhost/40123] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:02,694 INFO [Listener at localhost/40123] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:02,831 INFO [Listener at localhost/40123] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:02,901 DEBUG [Listener at localhost/40123] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-15 23:01:02,994 INFO [Listener at localhost/40123] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44547 2023-02-15 23:01:03,004 INFO [Listener at localhost/40123] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:03,006 INFO [Listener at localhost/40123] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:03,027 INFO [Listener at localhost/40123] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44547 connecting to ZooKeeper ensemble=127.0.0.1:64794 2023-02-15 23:01:03,071 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:445470x0, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:03,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44547-0x1005a3739cf0000 connected 2023-02-15 23:01:03,103 DEBUG [Listener at localhost/40123] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:03,104 DEBUG [Listener at localhost/40123] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:03,107 DEBUG [Listener at localhost/40123] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:03,115 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44547 2023-02-15 23:01:03,115 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44547 2023-02-15 23:01:03,115 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44547 2023-02-15 23:01:03,117 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44547 2023-02-15 23:01:03,117 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44547 2023-02-15 23:01:03,123 INFO [Listener at localhost/40123] master.HMaster(444): hbase.rootdir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964, hbase.cluster.distributed=false 2023-02-15 23:01:03,190 INFO [Listener at localhost/40123] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:03,191 INFO [Listener at localhost/40123] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:03,191 INFO [Listener at localhost/40123] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:03,191 INFO [Listener at localhost/40123] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:03,191 INFO [Listener at localhost/40123] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:03,191 INFO [Listener at localhost/40123] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:03,196 INFO [Listener at localhost/40123] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:03,199 INFO [Listener at localhost/40123] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33507 2023-02-15 23:01:03,201 INFO [Listener at localhost/40123] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:03,209 DEBUG [Listener at localhost/40123] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:03,210 INFO [Listener at localhost/40123] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:03,212 INFO [Listener at localhost/40123] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:03,214 INFO [Listener at localhost/40123] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33507 connecting to ZooKeeper ensemble=127.0.0.1:64794 2023-02-15 23:01:03,219 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:335070x0, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:03,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33507-0x1005a3739cf0001 connected 2023-02-15 23:01:03,220 DEBUG [Listener at localhost/40123] zookeeper.ZKUtil(164): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:03,221 DEBUG [Listener at localhost/40123] zookeeper.ZKUtil(164): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:03,222 DEBUG [Listener at localhost/40123] zookeeper.ZKUtil(164): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:03,223 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33507 2023-02-15 23:01:03,223 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33507 2023-02-15 23:01:03,224 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33507 2023-02-15 23:01:03,228 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33507 2023-02-15 23:01:03,228 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33507 2023-02-15 23:01:03,241 INFO [Listener at localhost/40123] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:03,241 INFO [Listener at localhost/40123] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:03,241 INFO [Listener at localhost/40123] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:03,241 INFO [Listener at localhost/40123] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:03,242 INFO [Listener at localhost/40123] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:03,242 INFO [Listener at localhost/40123] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:03,242 INFO [Listener at localhost/40123] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:03,243 INFO [Listener at localhost/40123] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43695 2023-02-15 23:01:03,244 INFO [Listener at localhost/40123] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:03,247 DEBUG [Listener at localhost/40123] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:03,247 INFO [Listener at localhost/40123] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:03,250 INFO [Listener at localhost/40123] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:03,253 INFO [Listener at localhost/40123] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43695 connecting to ZooKeeper ensemble=127.0.0.1:64794 2023-02-15 23:01:03,259 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:436950x0, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:03,260 DEBUG [Listener at localhost/40123] zookeeper.ZKUtil(164): regionserver:436950x0, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:03,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43695-0x1005a3739cf0002 connected 2023-02-15 23:01:03,261 DEBUG [Listener at localhost/40123] zookeeper.ZKUtil(164): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:03,262 DEBUG [Listener at localhost/40123] zookeeper.ZKUtil(164): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:03,264 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43695 2023-02-15 23:01:03,267 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43695 2023-02-15 23:01:03,267 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43695 2023-02-15 23:01:03,272 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43695 2023-02-15 23:01:03,272 DEBUG [Listener at localhost/40123] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43695 2023-02-15 23:01:03,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44547,1676502061974 2023-02-15 23:01:03,282 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:03,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44547,1676502061974 2023-02-15 23:01:03,302 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:03,302 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:03,302 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:03,302 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:03,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:03,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44547,1676502061974 from backup master directory 2023-02-15 23:01:03,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:03,310 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44547,1676502061974 2023-02-15 23:01:03,310 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:03,311 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:03,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44547,1676502061974 2023-02-15 23:01:03,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-15 23:01:03,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-15 23:01:03,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/hbase.id with ID: 7ed774a6-b622-469b-9da5-68e6c269cf86 2023-02-15 23:01:03,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:03,454 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:03,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6ca438cc to 127.0.0.1:64794 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:03,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69adea4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:03,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:03,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 23:01:03,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-15 23:01:03,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-15 23:01:03,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-15 23:01:03,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-15 23:01:03,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:03,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/MasterData/data/master/store-tmp 2023-02-15 23:01:03,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:03,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:03,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:03,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:03,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:03,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:03,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:03,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:03,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/MasterData/WALs/jenkins-hbase4.apache.org,44547,1676502061974 2023-02-15 23:01:03,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44547%2C1676502061974, suffix=, logDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/MasterData/WALs/jenkins-hbase4.apache.org,44547,1676502061974, archiveDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/MasterData/oldWALs, maxLogs=10 2023-02-15 23:01:03,847 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45649,DS-5f9da598-b847-4b10-9e55-b8593afb23fb,DISK] 2023-02-15 23:01:03,848 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38887,DS-8beed69b-6049-45b8-86df-69b4153512b3,DISK] 2023-02-15 23:01:03,856 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-15 23:01:03,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/MasterData/WALs/jenkins-hbase4.apache.org,44547,1676502061974/jenkins-hbase4.apache.org%2C44547%2C1676502061974.1676502063730 2023-02-15 23:01:03,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45649,DS-5f9da598-b847-4b10-9e55-b8593afb23fb,DISK], DatanodeInfoWithStorage[127.0.0.1:38887,DS-8beed69b-6049-45b8-86df-69b4153512b3,DISK]] 2023-02-15 23:01:03,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:03,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:03,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:03,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:04,006 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:04,013 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 23:01:04,047 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 23:01:04,059 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:04,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:04,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:04,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:04,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:04,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59478774, jitterRate=-0.11369720101356506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:04,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:04,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 23:01:04,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 23:01:04,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 23:01:04,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 23:01:04,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-15 23:01:04,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-02-15 23:01:04,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 23:01:04,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 23:01:04,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 23:01:04,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 23:01:04,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 23:01:04,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 23:01:04,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 23:01:04,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 23:01:04,248 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:04,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 23:01:04,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 23:01:04,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 23:01:04,268 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:04,268 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:04,268 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:04,268 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:04,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44547,1676502061974, sessionid=0x1005a3739cf0000, setting cluster-up flag (Was=false) 2023-02-15 23:01:04,285 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:04,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 23:01:04,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44547,1676502061974 2023-02-15 23:01:04,301 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:04,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 23:01:04,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44547,1676502061974 2023-02-15 23:01:04,316 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.hbase-snapshot/.tmp 2023-02-15 23:01:04,376 INFO [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(952): ClusterId : 7ed774a6-b622-469b-9da5-68e6c269cf86 2023-02-15 23:01:04,376 INFO [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(952): ClusterId : 7ed774a6-b622-469b-9da5-68e6c269cf86 2023-02-15 23:01:04,382 DEBUG [RS:0;jenkins-hbase4:33507] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:04,382 DEBUG [RS:1;jenkins-hbase4:43695] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:04,389 DEBUG [RS:0;jenkins-hbase4:33507] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:04,389 DEBUG [RS:1;jenkins-hbase4:43695] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:04,389 DEBUG [RS:0;jenkins-hbase4:33507] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:04,389 DEBUG [RS:1;jenkins-hbase4:43695] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:04,393 DEBUG [RS:1;jenkins-hbase4:43695] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:04,393 DEBUG [RS:0;jenkins-hbase4:33507] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:04,395 DEBUG [RS:1;jenkins-hbase4:43695] zookeeper.ReadOnlyZKClient(139): Connect 0x5a844062 to 127.0.0.1:64794 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:04,395 DEBUG [RS:0;jenkins-hbase4:33507] zookeeper.ReadOnlyZKClient(139): Connect 0x0fe8dcad to 127.0.0.1:64794 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:04,404 DEBUG [RS:1;jenkins-hbase4:43695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6202231d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:04,405 DEBUG [RS:0;jenkins-hbase4:33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79f7a092, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:04,405 DEBUG [RS:1;jenkins-hbase4:43695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@682b3d7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:04,406 DEBUG [RS:0;jenkins-hbase4:33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@273d7fa6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:04,429 DEBUG [RS:1;jenkins-hbase4:43695] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43695 2023-02-15 23:01:04,432 DEBUG [RS:0;jenkins-hbase4:33507] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33507 2023-02-15 23:01:04,437 INFO [RS:0;jenkins-hbase4:33507] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:04,438 INFO [RS:0;jenkins-hbase4:33507] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:04,437 INFO [RS:1;jenkins-hbase4:43695] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:04,438 DEBUG [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:04,438 INFO [RS:1;jenkins-hbase4:43695] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:04,438 DEBUG [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:04,441 INFO [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44547,1676502061974 with isa=jenkins-hbase4.apache.org/172.31.14.131:33507, startcode=1676502063190 2023-02-15 23:01:04,444 INFO [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44547,1676502061974 with isa=jenkins-hbase4.apache.org/172.31.14.131:43695, startcode=1676502063240 2023-02-15 23:01:04,463 DEBUG [RS:1;jenkins-hbase4:43695] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:04,463 DEBUG [RS:0;jenkins-hbase4:33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:04,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:04,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:04,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:04,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:04,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:04,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 23:01:04,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:04,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:04,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:04,520 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35947, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:04,520 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38403, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:04,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676502094525 2023-02-15 23:01:04,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 23:01:04,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44547] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 23:01:04,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 23:01:04,532 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:04,533 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 23:01:04,539 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:04,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 23:01:04,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 23:01:04,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 23:01:04,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 23:01:04,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 23:01:04,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:04,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 23:01:04,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 23:01:04,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 23:01:04,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 23:01:04,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 23:01:04,565 DEBUG [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(2829): Master is not running yet 2023-02-15 23:01:04,569 DEBUG [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(2829): Master is not running yet 2023-02-15 23:01:04,569 WARN [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-15 23:01:04,570 WARN [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-15 23:01:04,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502064571,5,FailOnTimeoutGroup] 2023-02-15 23:01:04,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502064573,5,FailOnTimeoutGroup] 2023-02-15 23:01:04,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:04,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 23:01:04,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:04,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:04,586 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:04,587 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:04,587 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964 2023-02-15 23:01:04,604 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:04,607 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:04,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/info 2023-02-15 23:01:04,611 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:04,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:04,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:04,614 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:04,614 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:04,615 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:04,615 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:04,617 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/table 2023-02-15 23:01:04,618 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:04,618 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:04,620 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740 2023-02-15 23:01:04,621 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740 2023-02-15 23:01:04,625 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:04,627 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:04,630 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:04,631 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61747677, jitterRate=-0.07988791167736053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:04,631 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:04,631 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:04,631 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:04,631 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:04,631 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:04,631 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:04,632 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:04,632 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:04,637 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:04,637 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 23:01:04,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 23:01:04,658 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 23:01:04,661 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 23:01:04,811 WARN [jenkins-hbase4:44547] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-15 23:01:05,571 INFO [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44547,1676502061974 with isa=jenkins-hbase4.apache.org/172.31.14.131:43695, startcode=1676502063240 2023-02-15 23:01:05,572 INFO [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44547,1676502061974 with isa=jenkins-hbase4.apache.org/172.31.14.131:33507, startcode=1676502063190 2023-02-15 23:01:05,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:05,577 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44547] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:05,584 DEBUG [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964 2023-02-15 23:01:05,584 DEBUG [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964 2023-02-15 23:01:05,585 DEBUG [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41805 2023-02-15 23:01:05,585 DEBUG [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41805 2023-02-15 23:01:05,585 DEBUG [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:05,585 DEBUG [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:05,590 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:05,596 DEBUG [RS:0;jenkins-hbase4:33507] zookeeper.ZKUtil(162): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:05,596 WARN [RS:0;jenkins-hbase4:33507] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:05,597 INFO [RS:0;jenkins-hbase4:33507] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:05,597 DEBUG [RS:1;jenkins-hbase4:43695] zookeeper.ZKUtil(162): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:05,597 DEBUG [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/WALs/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:05,597 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43695,1676502063240] 2023-02-15 23:01:05,597 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33507,1676502063190] 2023-02-15 23:01:05,597 WARN [RS:1;jenkins-hbase4:43695] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:05,597 INFO [RS:1;jenkins-hbase4:43695] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:05,598 DEBUG [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/WALs/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:05,608 DEBUG [RS:0;jenkins-hbase4:33507] zookeeper.ZKUtil(162): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:05,608 DEBUG [RS:1;jenkins-hbase4:43695] zookeeper.ZKUtil(162): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:05,609 DEBUG [RS:0;jenkins-hbase4:33507] zookeeper.ZKUtil(162): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:05,609 DEBUG [RS:1;jenkins-hbase4:43695] zookeeper.ZKUtil(162): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:05,621 DEBUG [RS:1;jenkins-hbase4:43695] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:05,621 DEBUG [RS:0;jenkins-hbase4:33507] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:05,631 INFO [RS:0;jenkins-hbase4:33507] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:05,631 INFO [RS:1;jenkins-hbase4:43695] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:05,652 INFO [RS:0;jenkins-hbase4:33507] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:05,652 INFO [RS:1;jenkins-hbase4:43695] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:05,657 INFO [RS:1;jenkins-hbase4:43695] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:05,657 INFO [RS:1;jenkins-hbase4:43695] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:05,657 INFO [RS:0;jenkins-hbase4:33507] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:05,658 INFO [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:05,658 INFO [RS:0;jenkins-hbase4:33507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:05,659 INFO [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:05,667 INFO [RS:1;jenkins-hbase4:43695] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:05,667 INFO [RS:0;jenkins-hbase4:33507] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:05,668 DEBUG [RS:1;jenkins-hbase4:43695] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,668 DEBUG [RS:0;jenkins-hbase4:33507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,668 DEBUG [RS:1;jenkins-hbase4:43695] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,668 DEBUG [RS:0;jenkins-hbase4:33507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,668 DEBUG [RS:1;jenkins-hbase4:43695] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,669 DEBUG [RS:0;jenkins-hbase4:33507] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,669 DEBUG [RS:1;jenkins-hbase4:43695] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,669 DEBUG [RS:0;jenkins-hbase4:33507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,669 DEBUG [RS:1;jenkins-hbase4:43695] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,669 DEBUG [RS:0;jenkins-hbase4:33507] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,669 DEBUG [RS:1;jenkins-hbase4:43695] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:05,669 DEBUG [RS:0;jenkins-hbase4:33507] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:05,669 DEBUG [RS:1;jenkins-hbase4:43695] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,669 DEBUG [RS:0;jenkins-hbase4:33507] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,669 DEBUG [RS:1;jenkins-hbase4:43695] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,670 DEBUG [RS:0;jenkins-hbase4:33507] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,670 DEBUG [RS:1;jenkins-hbase4:43695] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,670 DEBUG [RS:0;jenkins-hbase4:33507] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,670 DEBUG [RS:1;jenkins-hbase4:43695] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,670 DEBUG [RS:0;jenkins-hbase4:33507] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:05,671 INFO [RS:1;jenkins-hbase4:43695] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:05,671 INFO [RS:0;jenkins-hbase4:33507] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:05,672 INFO [RS:1;jenkins-hbase4:43695] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:05,672 INFO [RS:0;jenkins-hbase4:33507] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:05,672 INFO [RS:1;jenkins-hbase4:43695] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:05,672 INFO [RS:0;jenkins-hbase4:33507] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:05,689 INFO [RS:1;jenkins-hbase4:43695] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:05,689 INFO [RS:0;jenkins-hbase4:33507] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:05,692 INFO [RS:0;jenkins-hbase4:33507] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33507,1676502063190-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:05,692 INFO [RS:1;jenkins-hbase4:43695] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43695,1676502063240-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:05,712 INFO [RS:0;jenkins-hbase4:33507] regionserver.Replication(203): jenkins-hbase4.apache.org,33507,1676502063190 started 2023-02-15 23:01:05,712 INFO [RS:1;jenkins-hbase4:43695] regionserver.Replication(203): jenkins-hbase4.apache.org,43695,1676502063240 started 2023-02-15 23:01:05,712 INFO [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33507,1676502063190, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33507, sessionid=0x1005a3739cf0001 2023-02-15 23:01:05,712 INFO [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43695,1676502063240, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43695, sessionid=0x1005a3739cf0002 2023-02-15 23:01:05,712 DEBUG [RS:0;jenkins-hbase4:33507] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:05,712 DEBUG [RS:1;jenkins-hbase4:43695] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:05,713 DEBUG [RS:0;jenkins-hbase4:33507] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:05,713 DEBUG [RS:1;jenkins-hbase4:43695] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:05,714 DEBUG [RS:0;jenkins-hbase4:33507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33507,1676502063190' 2023-02-15 23:01:05,714 DEBUG [RS:1;jenkins-hbase4:43695] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43695,1676502063240' 2023-02-15 23:01:05,714 DEBUG [RS:1;jenkins-hbase4:43695] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:05,714 DEBUG [RS:0;jenkins-hbase4:33507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:05,715 DEBUG [RS:1;jenkins-hbase4:43695] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:05,715 DEBUG [RS:0;jenkins-hbase4:33507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:05,716 DEBUG [RS:1;jenkins-hbase4:43695] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:05,716 DEBUG [RS:1;jenkins-hbase4:43695] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:05,716 DEBUG [RS:1;jenkins-hbase4:43695] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:05,716 DEBUG [RS:1;jenkins-hbase4:43695] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43695,1676502063240' 2023-02-15 23:01:05,716 DEBUG [RS:1;jenkins-hbase4:43695] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:05,716 DEBUG [RS:0;jenkins-hbase4:33507] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:05,717 DEBUG [RS:0;jenkins-hbase4:33507] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:05,717 DEBUG [RS:0;jenkins-hbase4:33507] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:05,717 DEBUG [RS:0;jenkins-hbase4:33507] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33507,1676502063190' 2023-02-15 23:01:05,717 DEBUG [RS:0;jenkins-hbase4:33507] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:05,717 DEBUG [RS:1;jenkins-hbase4:43695] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:05,718 DEBUG [RS:0;jenkins-hbase4:33507] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:05,718 DEBUG [RS:1;jenkins-hbase4:43695] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:05,718 INFO [RS:1;jenkins-hbase4:43695] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:05,718 INFO [RS:1;jenkins-hbase4:43695] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:05,718 DEBUG [RS:0;jenkins-hbase4:33507] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:05,719 INFO [RS:0;jenkins-hbase4:33507] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:05,719 INFO [RS:0;jenkins-hbase4:33507] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:05,814 DEBUG [jenkins-hbase4:44547] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 23:01:05,818 DEBUG [jenkins-hbase4:44547] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:05,824 DEBUG [jenkins-hbase4:44547] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:05,824 DEBUG [jenkins-hbase4:44547] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:05,824 DEBUG [jenkins-hbase4:44547] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:05,828 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33507,1676502063190, state=OPENING 2023-02-15 23:01:05,835 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 23:01:05,837 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:05,837 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:05,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33507,1676502063190}] 2023-02-15 23:01:06,027 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:06,029 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:06,033 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59992, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:06,046 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 23:01:06,047 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:06,050 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33507%2C1676502063190.meta, suffix=.meta, logDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/WALs/jenkins-hbase4.apache.org,33507,1676502063190, archiveDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/oldWALs, maxLogs=32 2023-02-15 23:01:06,071 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38887,DS-8beed69b-6049-45b8-86df-69b4153512b3,DISK] 2023-02-15 23:01:06,071 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45649,DS-5f9da598-b847-4b10-9e55-b8593afb23fb,DISK] 2023-02-15 23:01:06,075 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/WALs/jenkins-hbase4.apache.org,33507,1676502063190/jenkins-hbase4.apache.org%2C33507%2C1676502063190.meta.1676502066053.meta 2023-02-15 23:01:06,075 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38887,DS-8beed69b-6049-45b8-86df-69b4153512b3,DISK], DatanodeInfoWithStorage[127.0.0.1:45649,DS-5f9da598-b847-4b10-9e55-b8593afb23fb,DISK]] 2023-02-15 23:01:06,075 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:06,077 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 23:01:06,094 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 23:01:06,099 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 23:01:06,105 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 23:01:06,105 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:06,105 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 23:01:06,105 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 23:01:06,108 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:06,110 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/info 2023-02-15 23:01:06,110 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/info 2023-02-15 23:01:06,111 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:06,112 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:06,112 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:06,114 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:06,114 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:06,114 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:06,115 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:06,116 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:06,117 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/table 2023-02-15 23:01:06,117 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/table 2023-02-15 23:01:06,118 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:06,119 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:06,121 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740 2023-02-15 23:01:06,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740 2023-02-15 23:01:06,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:06,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:06,132 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62846404, jitterRate=-0.06351560354232788}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:06,132 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:06,142 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676502066019 2023-02-15 23:01:06,161 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 23:01:06,162 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 23:01:06,162 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33507,1676502063190, state=OPEN 2023-02-15 23:01:06,165 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 23:01:06,166 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:06,170 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 23:01:06,170 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33507,1676502063190 in 325 msec 2023-02-15 23:01:06,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 23:01:06,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.5250 sec 2023-02-15 23:01:06,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.7780 sec 2023-02-15 23:01:06,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676502066181, completionTime=-1 2023-02-15 23:01:06,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 23:01:06,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 23:01:06,247 DEBUG [hconnection-0x5dbda4dc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:06,251 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60002, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:06,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 23:01:06,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676502126268 2023-02-15 23:01:06,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676502186268 2023-02-15 23:01:06,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 86 msec 2023-02-15 23:01:06,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44547,1676502061974-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:06,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44547,1676502061974-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:06,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44547,1676502061974-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:06,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44547, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:06,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:06,301 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 23:01:06,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 23:01:06,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:06,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 23:01:06,324 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:06,327 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:06,349 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/hbase/namespace/a3745ab366923d5a288dcc5afe26f918 2023-02-15 23:01:06,352 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/hbase/namespace/a3745ab366923d5a288dcc5afe26f918 empty. 2023-02-15 23:01:06,352 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/hbase/namespace/a3745ab366923d5a288dcc5afe26f918 2023-02-15 23:01:06,353 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 23:01:06,381 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:06,383 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a3745ab366923d5a288dcc5afe26f918, NAME => 'hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp 2023-02-15 23:01:06,404 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:06,405 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a3745ab366923d5a288dcc5afe26f918, disabling compactions & flushes 2023-02-15 23:01:06,405 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. 2023-02-15 23:01:06,405 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. 2023-02-15 23:01:06,405 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. after waiting 0 ms 2023-02-15 23:01:06,405 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. 2023-02-15 23:01:06,405 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. 2023-02-15 23:01:06,405 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a3745ab366923d5a288dcc5afe26f918: 2023-02-15 23:01:06,410 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:06,424 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502066413"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502066413"}]},"ts":"1676502066413"} 2023-02-15 23:01:06,454 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 23:01:06,456 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:06,461 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502066457"}]},"ts":"1676502066457"} 2023-02-15 23:01:06,465 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 23:01:06,469 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:06,471 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:06,471 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:06,471 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:06,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a3745ab366923d5a288dcc5afe26f918, ASSIGN}] 2023-02-15 23:01:06,477 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a3745ab366923d5a288dcc5afe26f918, ASSIGN 2023-02-15 23:01:06,479 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a3745ab366923d5a288dcc5afe26f918, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33507,1676502063190; forceNewPlan=false, retain=false 2023-02-15 23:01:06,632 INFO [jenkins-hbase4:44547] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 23:01:06,633 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a3745ab366923d5a288dcc5afe26f918, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:06,634 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502066633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502066633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502066633"}]},"ts":"1676502066633"} 2023-02-15 23:01:06,639 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a3745ab366923d5a288dcc5afe26f918, server=jenkins-hbase4.apache.org,33507,1676502063190}] 2023-02-15 23:01:06,734 INFO [RS:0;jenkins-hbase4:33507] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33507%2C1676502063190, suffix=, logDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/WALs/jenkins-hbase4.apache.org,33507,1676502063190, archiveDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/oldWALs, maxLogs=32 2023-02-15 23:01:06,745 INFO [RS:1;jenkins-hbase4:43695] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43695%2C1676502063240, suffix=, logDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/WALs/jenkins-hbase4.apache.org,43695,1676502063240, archiveDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/oldWALs, maxLogs=32 2023-02-15 23:01:06,756 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38887,DS-8beed69b-6049-45b8-86df-69b4153512b3,DISK] 2023-02-15 23:01:06,756 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45649,DS-5f9da598-b847-4b10-9e55-b8593afb23fb,DISK] 2023-02-15 23:01:06,766 INFO [RS:0;jenkins-hbase4:33507] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/WALs/jenkins-hbase4.apache.org,33507,1676502063190/jenkins-hbase4.apache.org%2C33507%2C1676502063190.1676502066737 2023-02-15 23:01:06,766 DEBUG [RS:0;jenkins-hbase4:33507] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38887,DS-8beed69b-6049-45b8-86df-69b4153512b3,DISK], DatanodeInfoWithStorage[127.0.0.1:45649,DS-5f9da598-b847-4b10-9e55-b8593afb23fb,DISK]] 2023-02-15 23:01:06,774 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38887,DS-8beed69b-6049-45b8-86df-69b4153512b3,DISK] 2023-02-15 23:01:06,774 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45649,DS-5f9da598-b847-4b10-9e55-b8593afb23fb,DISK] 2023-02-15 23:01:06,784 INFO [RS:1;jenkins-hbase4:43695] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/WALs/jenkins-hbase4.apache.org,43695,1676502063240/jenkins-hbase4.apache.org%2C43695%2C1676502063240.1676502066747 2023-02-15 23:01:06,785 DEBUG [RS:1;jenkins-hbase4:43695] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38887,DS-8beed69b-6049-45b8-86df-69b4153512b3,DISK], DatanodeInfoWithStorage[127.0.0.1:45649,DS-5f9da598-b847-4b10-9e55-b8593afb23fb,DISK]] 2023-02-15 23:01:06,805 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. 2023-02-15 23:01:06,806 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a3745ab366923d5a288dcc5afe26f918, NAME => 'hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:06,808 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a3745ab366923d5a288dcc5afe26f918 2023-02-15 23:01:06,808 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:06,808 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a3745ab366923d5a288dcc5afe26f918 2023-02-15 23:01:06,808 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a3745ab366923d5a288dcc5afe26f918 2023-02-15 23:01:06,811 INFO [StoreOpener-a3745ab366923d5a288dcc5afe26f918-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a3745ab366923d5a288dcc5afe26f918 2023-02-15 23:01:06,814 DEBUG [StoreOpener-a3745ab366923d5a288dcc5afe26f918-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/namespace/a3745ab366923d5a288dcc5afe26f918/info 2023-02-15 23:01:06,814 DEBUG [StoreOpener-a3745ab366923d5a288dcc5afe26f918-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/namespace/a3745ab366923d5a288dcc5afe26f918/info 2023-02-15 23:01:06,814 INFO [StoreOpener-a3745ab366923d5a288dcc5afe26f918-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3745ab366923d5a288dcc5afe26f918 columnFamilyName info 2023-02-15 23:01:06,815 INFO [StoreOpener-a3745ab366923d5a288dcc5afe26f918-1] regionserver.HStore(310): Store=a3745ab366923d5a288dcc5afe26f918/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:06,817 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/namespace/a3745ab366923d5a288dcc5afe26f918 2023-02-15 23:01:06,818 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/namespace/a3745ab366923d5a288dcc5afe26f918 2023-02-15 23:01:06,823 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a3745ab366923d5a288dcc5afe26f918 2023-02-15 23:01:06,826 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/namespace/a3745ab366923d5a288dcc5afe26f918/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:06,827 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a3745ab366923d5a288dcc5afe26f918; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72841647, jitterRate=0.08542512357234955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:06,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a3745ab366923d5a288dcc5afe26f918: 2023-02-15 23:01:06,830 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918., pid=6, masterSystemTime=1676502066792 2023-02-15 23:01:06,837 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a3745ab366923d5a288dcc5afe26f918, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:06,837 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502066836"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502066836"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502066836"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502066836"}]},"ts":"1676502066836"} 2023-02-15 23:01:06,846 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. 2023-02-15 23:01:06,846 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. 2023-02-15 23:01:06,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 23:01:06,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a3745ab366923d5a288dcc5afe26f918, server=jenkins-hbase4.apache.org,33507,1676502063190 in 203 msec 2023-02-15 23:01:06,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 23:01:06,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a3745ab366923d5a288dcc5afe26f918, ASSIGN in 376 msec 2023-02-15 23:01:06,855 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:06,855 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502066855"}]},"ts":"1676502066855"} 2023-02-15 23:01:06,858 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 23:01:06,863 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:06,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 551 msec 2023-02-15 23:01:06,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 23:01:06,927 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:06,927 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:06,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 23:01:07,001 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:07,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-02-15 23:01:07,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 23:01:07,030 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:07,035 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-15 23:01:07,044 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 23:01:07,047 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 23:01:07,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.737sec 2023-02-15 23:01:07,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 23:01:07,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 23:01:07,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 23:01:07,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44547,1676502061974-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 23:01:07,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44547,1676502061974-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 23:01:07,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 23:01:07,083 DEBUG [Listener at localhost/40123] zookeeper.ReadOnlyZKClient(139): Connect 0x659a4d79 to 127.0.0.1:64794 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:07,088 DEBUG [Listener at localhost/40123] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1413088b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:07,135 DEBUG [hconnection-0x1f92f1d8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:07,147 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60010, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:07,159 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44547,1676502061974 2023-02-15 23:01:07,160 DEBUG [Listener at localhost/40123] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 23:01:07,172 DEBUG [Listener at localhost/40123] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 23:01:07,175 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58574, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 23:01:07,180 INFO [Listener at localhost/40123] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 23:01:07,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 23:01:07,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 23:01:07,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:58574 deadline: 1676502127185, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-15 23:01:07,189 INFO [Listener at localhost/40123] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-15 23:01:07,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:07,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-15 23:01:07,208 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:07,210 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:07,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-15 23:01:07,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:07,232 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:07,232 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:07,232 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978 2023-02-15 23:01:07,233 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:07,233 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936 empty. 2023-02-15 23:01:07,233 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:07,233 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:07,234 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:07,233 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978 empty. 2023-02-15 23:01:07,236 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:07,236 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:07,235 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:07,236 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b empty. 2023-02-15 23:01:07,236 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d empty. 2023-02-15 23:01:07,236 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e empty. 2023-02-15 23:01:07,236 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978 2023-02-15 23:01:07,237 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:07,237 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db empty. 2023-02-15 23:01:07,237 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4 empty. 2023-02-15 23:01:07,237 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:07,237 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:07,237 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e empty. 2023-02-15 23:01:07,238 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:07,238 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48 empty. 2023-02-15 23:01:07,238 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:07,238 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe empty. 2023-02-15 23:01:07,238 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:07,239 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:07,239 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:07,239 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:07,239 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 23:01:07,269 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:07,273 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7c06162354c42cfe1212016459f5e936, NAME => 'testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp 2023-02-15 23:01:07,274 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 225454195a3f647766b594b547f3a978, NAME => 'testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp 2023-02-15 23:01:07,275 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => cc38f1967537aa31f1fc74a629715aa4, NAME => 'testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp 2023-02-15 23:01:07,328 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:07,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 7c06162354c42cfe1212016459f5e936, disabling compactions & flushes 2023-02-15 23:01:07,329 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:07,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:07,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. after waiting 0 ms 2023-02-15 23:01:07,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:07,329 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:07,329 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 7c06162354c42cfe1212016459f5e936: 2023-02-15 23:01:07,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:07,331 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing cc38f1967537aa31f1fc74a629715aa4, disabling compactions & flushes 2023-02-15 23:01:07,331 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:07,331 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:07,331 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. after waiting 0 ms 2023-02-15 23:01:07,331 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:07,331 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:07,331 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for cc38f1967537aa31f1fc74a629715aa4: 2023-02-15 23:01:07,332 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0190671bf7339a24b5cfb6398a4cd63d, NAME => 'testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp 2023-02-15 23:01:07,330 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d6f280ccad96b13bef3dc4771819bf8e, NAME => 'testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp 2023-02-15 23:01:07,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:07,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:07,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d6f280ccad96b13bef3dc4771819bf8e, disabling compactions & flushes 2023-02-15 23:01:07,357 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:07,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:07,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. after waiting 0 ms 2023-02-15 23:01:07,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:07,357 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:07,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d6f280ccad96b13bef3dc4771819bf8e: 2023-02-15 23:01:07,358 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 72bd5387fbbb2a758e40270a96f8650e, NAME => 'testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp 2023-02-15 23:01:07,375 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:07,375 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 0190671bf7339a24b5cfb6398a4cd63d, disabling compactions & flushes 2023-02-15 23:01:07,375 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:07,375 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:07,376 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. after waiting 0 ms 2023-02-15 23:01:07,376 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:07,376 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:07,376 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 0190671bf7339a24b5cfb6398a4cd63d: 2023-02-15 23:01:07,376 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:07,377 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 72bd5387fbbb2a758e40270a96f8650e, disabling compactions & flushes 2023-02-15 23:01:07,377 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9c651e4cdd5d3eb51ce657623e66c7db, NAME => 'testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp 2023-02-15 23:01:07,377 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:07,377 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:07,377 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. after waiting 0 ms 2023-02-15 23:01:07,377 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:07,377 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:07,377 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 72bd5387fbbb2a758e40270a96f8650e: 2023-02-15 23:01:07,378 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => a1f5cc5d6ade79c61316452d39fcdd7b, NAME => 'testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp 2023-02-15 23:01:07,396 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:07,396 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing a1f5cc5d6ade79c61316452d39fcdd7b, disabling compactions & flushes 2023-02-15 23:01:07,396 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:07,396 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:07,396 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. after waiting 0 ms 2023-02-15 23:01:07,396 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:07,397 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:07,397 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for a1f5cc5d6ade79c61316452d39fcdd7b: 2023-02-15 23:01:07,397 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7b66ad5c51d40cceb1755ffa12528a48, NAME => 'testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp 2023-02-15 23:01:07,397 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:07,398 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 9c651e4cdd5d3eb51ce657623e66c7db, disabling compactions & flushes 2023-02-15 23:01:07,398 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:07,398 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:07,398 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. after waiting 0 ms 2023-02-15 23:01:07,398 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:07,398 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:07,398 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 9c651e4cdd5d3eb51ce657623e66c7db: 2023-02-15 23:01:07,399 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7bda59cbbe289d53689c842d819b62fe, NAME => 'testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp 2023-02-15 23:01:07,424 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:07,424 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 7bda59cbbe289d53689c842d819b62fe, disabling compactions & flushes 2023-02-15 23:01:07,424 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:07,425 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:07,425 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. after waiting 0 ms 2023-02-15 23:01:07,425 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:07,425 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:07,425 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 7bda59cbbe289d53689c842d819b62fe: 2023-02-15 23:01:07,427 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:07,428 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 7b66ad5c51d40cceb1755ffa12528a48, disabling compactions & flushes 2023-02-15 23:01:07,428 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:07,428 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:07,428 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. after waiting 0 ms 2023-02-15 23:01:07,428 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:07,428 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:07,462 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 7b66ad5c51d40cceb1755ffa12528a48: 2023-02-15 23:01:07,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:07,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:07,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 225454195a3f647766b594b547f3a978, disabling compactions & flushes 2023-02-15 23:01:07,732 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:07,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:07,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. after waiting 0 ms 2023-02-15 23:01:07,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:07,732 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:07,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 225454195a3f647766b594b547f3a978: 2023-02-15 23:01:07,738 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:07,740 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502067739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502067739"}]},"ts":"1676502067739"} 2023-02-15 23:01:07,740 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502067739"}]},"ts":"1676502067739"} 2023-02-15 23:01:07,740 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502067739"}]},"ts":"1676502067739"} 2023-02-15 23:01:07,740 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502067739"}]},"ts":"1676502067739"} 2023-02-15 23:01:07,740 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502067739"}]},"ts":"1676502067739"} 2023-02-15 23:01:07,740 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502067739"}]},"ts":"1676502067739"} 2023-02-15 23:01:07,740 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502067739"}]},"ts":"1676502067739"} 2023-02-15 23:01:07,741 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502067739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502067739"}]},"ts":"1676502067739"} 2023-02-15 23:01:07,741 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502067739"}]},"ts":"1676502067739"} 2023-02-15 23:01:07,741 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676502067198.225454195a3f647766b594b547f3a978.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502067739"}]},"ts":"1676502067739"} 2023-02-15 23:01:07,791 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-15 23:01:07,793 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:07,793 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502067793"}]},"ts":"1676502067793"} 2023-02-15 23:01:07,796 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-15 23:01:07,801 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:07,815 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:07,815 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:07,815 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:07,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7c06162354c42cfe1212016459f5e936, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cc38f1967537aa31f1fc74a629715aa4, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=225454195a3f647766b594b547f3a978, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d6f280ccad96b13bef3dc4771819bf8e, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0190671bf7339a24b5cfb6398a4cd63d, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=72bd5387fbbb2a758e40270a96f8650e, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9c651e4cdd5d3eb51ce657623e66c7db, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a1f5cc5d6ade79c61316452d39fcdd7b, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7b66ad5c51d40cceb1755ffa12528a48, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7bda59cbbe289d53689c842d819b62fe, ASSIGN}] 2023-02-15 23:01:07,820 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7bda59cbbe289d53689c842d819b62fe, ASSIGN 2023-02-15 23:01:07,820 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a1f5cc5d6ade79c61316452d39fcdd7b, ASSIGN 2023-02-15 23:01:07,821 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7b66ad5c51d40cceb1755ffa12528a48, ASSIGN 2023-02-15 23:01:07,821 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9c651e4cdd5d3eb51ce657623e66c7db, ASSIGN 2023-02-15 23:01:07,822 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=72bd5387fbbb2a758e40270a96f8650e, ASSIGN 2023-02-15 23:01:07,822 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7bda59cbbe289d53689c842d819b62fe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33507,1676502063190; forceNewPlan=false, retain=false 2023-02-15 23:01:07,822 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a1f5cc5d6ade79c61316452d39fcdd7b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33507,1676502063190; forceNewPlan=false, retain=false 2023-02-15 23:01:07,822 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7b66ad5c51d40cceb1755ffa12528a48, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43695,1676502063240; forceNewPlan=false, retain=false 2023-02-15 23:01:07,823 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9c651e4cdd5d3eb51ce657623e66c7db, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43695,1676502063240; forceNewPlan=false, retain=false 2023-02-15 23:01:07,824 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=72bd5387fbbb2a758e40270a96f8650e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43695,1676502063240; forceNewPlan=false, retain=false 2023-02-15 23:01:07,824 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0190671bf7339a24b5cfb6398a4cd63d, ASSIGN 2023-02-15 23:01:07,824 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cc38f1967537aa31f1fc74a629715aa4, ASSIGN 2023-02-15 23:01:07,825 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d6f280ccad96b13bef3dc4771819bf8e, ASSIGN 2023-02-15 23:01:07,825 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=225454195a3f647766b594b547f3a978, ASSIGN 2023-02-15 23:01:07,826 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7c06162354c42cfe1212016459f5e936, ASSIGN 2023-02-15 23:01:07,826 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0190671bf7339a24b5cfb6398a4cd63d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33507,1676502063190; forceNewPlan=false, retain=false 2023-02-15 23:01:07,827 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d6f280ccad96b13bef3dc4771819bf8e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43695,1676502063240; forceNewPlan=false, retain=false 2023-02-15 23:01:07,827 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=225454195a3f647766b594b547f3a978, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33507,1676502063190; forceNewPlan=false, retain=false 2023-02-15 23:01:07,827 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cc38f1967537aa31f1fc74a629715aa4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33507,1676502063190; forceNewPlan=false, retain=false 2023-02-15 23:01:07,827 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7c06162354c42cfe1212016459f5e936, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43695,1676502063240; forceNewPlan=false, retain=false 2023-02-15 23:01:07,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:07,973 INFO [jenkins-hbase4:44547] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-15 23:01:07,977 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7c06162354c42cfe1212016459f5e936, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:07,977 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=72bd5387fbbb2a758e40270a96f8650e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:07,977 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7b66ad5c51d40cceb1755ffa12528a48, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:07,977 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502067977"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502067977"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502067977"}]},"ts":"1676502067977"} 2023-02-15 23:01:07,977 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9c651e4cdd5d3eb51ce657623e66c7db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:07,977 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067977"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502067977"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502067977"}]},"ts":"1676502067977"} 2023-02-15 23:01:07,977 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067977"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502067977"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502067977"}]},"ts":"1676502067977"} 2023-02-15 23:01:07,978 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067977"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502067977"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502067977"}]},"ts":"1676502067977"} 2023-02-15 23:01:07,977 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d6f280ccad96b13bef3dc4771819bf8e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:07,979 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067977"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502067977"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502067977"}]},"ts":"1676502067977"} 2023-02-15 23:01:07,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=11, state=RUNNABLE; OpenRegionProcedure 7c06162354c42cfe1212016459f5e936, server=jenkins-hbase4.apache.org,43695,1676502063240}] 2023-02-15 23:01:07,987 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; OpenRegionProcedure 7b66ad5c51d40cceb1755ffa12528a48, server=jenkins-hbase4.apache.org,43695,1676502063240}] 2023-02-15 23:01:07,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=16, state=RUNNABLE; OpenRegionProcedure 72bd5387fbbb2a758e40270a96f8650e, server=jenkins-hbase4.apache.org,43695,1676502063240}] 2023-02-15 23:01:07,990 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure 9c651e4cdd5d3eb51ce657623e66c7db, server=jenkins-hbase4.apache.org,43695,1676502063240}] 2023-02-15 23:01:07,993 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0190671bf7339a24b5cfb6398a4cd63d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:07,993 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067993"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502067993"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502067993"}]},"ts":"1676502067993"} 2023-02-15 23:01:07,993 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure d6f280ccad96b13bef3dc4771819bf8e, server=jenkins-hbase4.apache.org,43695,1676502063240}] 2023-02-15 23:01:07,996 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=a1f5cc5d6ade79c61316452d39fcdd7b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:07,996 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067996"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502067996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502067996"}]},"ts":"1676502067996"} 2023-02-15 23:01:07,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure 0190671bf7339a24b5cfb6398a4cd63d, server=jenkins-hbase4.apache.org,33507,1676502063190}] 2023-02-15 23:01:07,998 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=225454195a3f647766b594b547f3a978, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:07,998 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676502067198.225454195a3f647766b594b547f3a978.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502067998"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502067998"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502067998"}]},"ts":"1676502067998"} 2023-02-15 23:01:08,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=18, state=RUNNABLE; OpenRegionProcedure a1f5cc5d6ade79c61316452d39fcdd7b, server=jenkins-hbase4.apache.org,33507,1676502063190}] 2023-02-15 23:01:08,001 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=cc38f1967537aa31f1fc74a629715aa4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:08,001 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502068001"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502068001"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502068001"}]},"ts":"1676502068001"} 2023-02-15 23:01:08,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 225454195a3f647766b594b547f3a978, server=jenkins-hbase4.apache.org,33507,1676502063190}] 2023-02-15 23:01:08,003 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7bda59cbbe289d53689c842d819b62fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:08,004 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502068003"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502068003"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502068003"}]},"ts":"1676502068003"} 2023-02-15 23:01:08,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure cc38f1967537aa31f1fc74a629715aa4, server=jenkins-hbase4.apache.org,33507,1676502063190}] 2023-02-15 23:01:08,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=20, state=RUNNABLE; OpenRegionProcedure 7bda59cbbe289d53689c842d819b62fe, server=jenkins-hbase4.apache.org,33507,1676502063190}] 2023-02-15 23:01:08,137 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:08,138 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:08,142 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53822, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:08,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:08,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7c06162354c42cfe1212016459f5e936, NAME => 'testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-15 23:01:08,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:08,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:08,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:08,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:08,151 INFO [StoreOpener-7c06162354c42cfe1212016459f5e936-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:08,154 DEBUG [StoreOpener-7c06162354c42cfe1212016459f5e936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936/f1 2023-02-15 23:01:08,154 DEBUG [StoreOpener-7c06162354c42cfe1212016459f5e936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936/f1 2023-02-15 23:01:08,154 INFO [StoreOpener-7c06162354c42cfe1212016459f5e936-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c06162354c42cfe1212016459f5e936 columnFamilyName f1 2023-02-15 23:01:08,155 INFO [StoreOpener-7c06162354c42cfe1212016459f5e936-1] regionserver.HStore(310): Store=7c06162354c42cfe1212016459f5e936/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,156 INFO [StoreOpener-7c06162354c42cfe1212016459f5e936-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:08,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:08,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 225454195a3f647766b594b547f3a978, NAME => 'testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-15 23:01:08,161 DEBUG [StoreOpener-7c06162354c42cfe1212016459f5e936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936/f2 2023-02-15 23:01:08,161 DEBUG [StoreOpener-7c06162354c42cfe1212016459f5e936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936/f2 2023-02-15 23:01:08,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 225454195a3f647766b594b547f3a978 2023-02-15 23:01:08,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:08,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 225454195a3f647766b594b547f3a978 2023-02-15 23:01:08,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 225454195a3f647766b594b547f3a978 2023-02-15 23:01:08,161 INFO [StoreOpener-7c06162354c42cfe1212016459f5e936-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c06162354c42cfe1212016459f5e936 columnFamilyName f2 2023-02-15 23:01:08,162 INFO [StoreOpener-7c06162354c42cfe1212016459f5e936-1] regionserver.HStore(310): Store=7c06162354c42cfe1212016459f5e936/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,164 INFO [StoreOpener-225454195a3f647766b594b547f3a978-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 225454195a3f647766b594b547f3a978 2023-02-15 23:01:08,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:08,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:08,166 DEBUG [StoreOpener-225454195a3f647766b594b547f3a978-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1 2023-02-15 23:01:08,166 DEBUG [StoreOpener-225454195a3f647766b594b547f3a978-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1 2023-02-15 23:01:08,167 INFO [StoreOpener-225454195a3f647766b594b547f3a978-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 225454195a3f647766b594b547f3a978 columnFamilyName f1 2023-02-15 23:01:08,167 INFO [StoreOpener-225454195a3f647766b594b547f3a978-1] regionserver.HStore(310): Store=225454195a3f647766b594b547f3a978/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,168 INFO [StoreOpener-225454195a3f647766b594b547f3a978-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 225454195a3f647766b594b547f3a978 2023-02-15 23:01:08,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:08,170 DEBUG [StoreOpener-225454195a3f647766b594b547f3a978-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2 2023-02-15 23:01:08,170 DEBUG [StoreOpener-225454195a3f647766b594b547f3a978-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2 2023-02-15 23:01:08,171 INFO [StoreOpener-225454195a3f647766b594b547f3a978-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 225454195a3f647766b594b547f3a978 columnFamilyName f2 2023-02-15 23:01:08,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:08,172 INFO [StoreOpener-225454195a3f647766b594b547f3a978-1] regionserver.HStore(310): Store=225454195a3f647766b594b547f3a978/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978 2023-02-15 23:01:08,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978 2023-02-15 23:01:08,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:08,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7c06162354c42cfe1212016459f5e936; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60645171, jitterRate=-0.09631653130054474}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:08,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7c06162354c42cfe1212016459f5e936: 2023-02-15 23:01:08,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936., pid=21, masterSystemTime=1676502068137 2023-02-15 23:01:08,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:08,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:08,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 225454195a3f647766b594b547f3a978 2023-02-15 23:01:08,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:08,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:08,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d6f280ccad96b13bef3dc4771819bf8e, NAME => 'testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-15 23:01:08,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:08,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:08,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:08,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:08,184 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7c06162354c42cfe1212016459f5e936, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:08,185 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502068184"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502068184"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502068184"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502068184"}]},"ts":"1676502068184"} 2023-02-15 23:01:08,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:08,196 INFO [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:08,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 225454195a3f647766b594b547f3a978; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68037257, jitterRate=0.013834133744239807}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:08,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 225454195a3f647766b594b547f3a978: 2023-02-15 23:01:08,199 DEBUG [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1 2023-02-15 23:01:08,199 DEBUG [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1 2023-02-15 23:01:08,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978., pid=28, masterSystemTime=1676502068150 2023-02-15 23:01:08,200 INFO [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6f280ccad96b13bef3dc4771819bf8e columnFamilyName f1 2023-02-15 23:01:08,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=11 2023-02-15 23:01:08,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=11, state=SUCCESS; OpenRegionProcedure 7c06162354c42cfe1212016459f5e936, server=jenkins-hbase4.apache.org,43695,1676502063240 in 207 msec 2023-02-15 23:01:08,201 INFO [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] regionserver.HStore(310): Store=d6f280ccad96b13bef3dc4771819bf8e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,201 INFO [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:08,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:08,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:08,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:08,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cc38f1967537aa31f1fc74a629715aa4, NAME => 'testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-15 23:01:08,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7c06162354c42cfe1212016459f5e936, ASSIGN in 385 msec 2023-02-15 23:01:08,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:08,204 DEBUG [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2 2023-02-15 23:01:08,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:08,204 DEBUG [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2 2023-02-15 23:01:08,204 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=225454195a3f647766b594b547f3a978, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:08,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:08,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:08,204 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676502067198.225454195a3f647766b594b547f3a978.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502068204"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502068204"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502068204"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502068204"}]},"ts":"1676502068204"} 2023-02-15 23:01:08,204 INFO [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6f280ccad96b13bef3dc4771819bf8e columnFamilyName f2 2023-02-15 23:01:08,205 INFO [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] regionserver.HStore(310): Store=d6f280ccad96b13bef3dc4771819bf8e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:08,212 INFO [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:08,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:08,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-15 23:01:08,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 225454195a3f647766b594b547f3a978, server=jenkins-hbase4.apache.org,33507,1676502063190 in 210 msec 2023-02-15 23:01:08,217 DEBUG [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1 2023-02-15 23:01:08,217 DEBUG [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1 2023-02-15 23:01:08,217 INFO [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc38f1967537aa31f1fc74a629715aa4 columnFamilyName f1 2023-02-15 23:01:08,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:08,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=225454195a3f647766b594b547f3a978, ASSIGN in 401 msec 2023-02-15 23:01:08,219 INFO [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] regionserver.HStore(310): Store=cc38f1967537aa31f1fc74a629715aa4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,219 INFO [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:08,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:08,226 DEBUG [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2 2023-02-15 23:01:08,226 DEBUG [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2 2023-02-15 23:01:08,228 INFO [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc38f1967537aa31f1fc74a629715aa4 columnFamilyName f2 2023-02-15 23:01:08,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:08,229 INFO [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] regionserver.HStore(310): Store=cc38f1967537aa31f1fc74a629715aa4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d6f280ccad96b13bef3dc4771819bf8e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68753653, jitterRate=0.024509266018867493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:08,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d6f280ccad96b13bef3dc4771819bf8e: 2023-02-15 23:01:08,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:08,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e., pid=25, masterSystemTime=1676502068137 2023-02-15 23:01:08,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:08,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:08,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:08,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:08,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9c651e4cdd5d3eb51ce657623e66c7db, NAME => 'testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-15 23:01:08,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:08,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:08,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:08,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:08,237 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d6f280ccad96b13bef3dc4771819bf8e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:08,237 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502068237"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502068237"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502068237"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502068237"}]},"ts":"1676502068237"} 2023-02-15 23:01:08,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:08,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:08,240 INFO [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:08,244 DEBUG [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1 2023-02-15 23:01:08,244 DEBUG [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1 2023-02-15 23:01:08,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:08,245 INFO [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c651e4cdd5d3eb51ce657623e66c7db columnFamilyName f1 2023-02-15 23:01:08,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cc38f1967537aa31f1fc74a629715aa4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73489927, jitterRate=0.0950852483510971}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:08,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cc38f1967537aa31f1fc74a629715aa4: 2023-02-15 23:01:08,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-15 23:01:08,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure d6f280ccad96b13bef3dc4771819bf8e, server=jenkins-hbase4.apache.org,43695,1676502063240 in 247 msec 2023-02-15 23:01:08,246 INFO [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] regionserver.HStore(310): Store=9c651e4cdd5d3eb51ce657623e66c7db/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,246 INFO [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:08,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4., pid=29, masterSystemTime=1676502068150 2023-02-15 23:01:08,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d6f280ccad96b13bef3dc4771819bf8e, ASSIGN in 431 msec 2023-02-15 23:01:08,248 DEBUG [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2 2023-02-15 23:01:08,248 DEBUG [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2 2023-02-15 23:01:08,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:08,249 INFO [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c651e4cdd5d3eb51ce657623e66c7db columnFamilyName f2 2023-02-15 23:01:08,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:08,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:08,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a1f5cc5d6ade79c61316452d39fcdd7b, NAME => 'testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-15 23:01:08,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:08,250 INFO [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] regionserver.HStore(310): Store=9c651e4cdd5d3eb51ce657623e66c7db/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,250 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=cc38f1967537aa31f1fc74a629715aa4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:08,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:08,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:08,251 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502068250"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502068250"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502068250"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502068250"}]},"ts":"1676502068250"} 2023-02-15 23:01:08,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:08,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:08,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:08,253 INFO [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:08,255 DEBUG [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1 2023-02-15 23:01:08,256 DEBUG [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1 2023-02-15 23:01:08,256 INFO [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1f5cc5d6ade79c61316452d39fcdd7b columnFamilyName f1 2023-02-15 23:01:08,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:08,257 INFO [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] regionserver.HStore(310): Store=a1f5cc5d6ade79c61316452d39fcdd7b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-15 23:01:08,258 INFO [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:08,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure cc38f1967537aa31f1fc74a629715aa4, server=jenkins-hbase4.apache.org,33507,1676502063190 in 250 msec 2023-02-15 23:01:08,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:08,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cc38f1967537aa31f1fc74a629715aa4, ASSIGN in 443 msec 2023-02-15 23:01:08,261 DEBUG [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2 2023-02-15 23:01:08,261 DEBUG [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2 2023-02-15 23:01:08,261 INFO [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1f5cc5d6ade79c61316452d39fcdd7b columnFamilyName f2 2023-02-15 23:01:08,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:08,262 INFO [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] regionserver.HStore(310): Store=a1f5cc5d6ade79c61316452d39fcdd7b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9c651e4cdd5d3eb51ce657623e66c7db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74927469, jitterRate=0.11650629341602325}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:08,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9c651e4cdd5d3eb51ce657623e66c7db: 2023-02-15 23:01:08,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:08,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db., pid=24, masterSystemTime=1676502068137 2023-02-15 23:01:08,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:08,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:08,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:08,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:08,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7b66ad5c51d40cceb1755ffa12528a48, NAME => 'testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-15 23:01:08,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:08,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:08,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:08,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:08,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:08,269 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9c651e4cdd5d3eb51ce657623e66c7db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:08,269 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502068269"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502068269"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502068269"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502068269"}]},"ts":"1676502068269"} 2023-02-15 23:01:08,271 INFO [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:08,274 DEBUG [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1 2023-02-15 23:01:08,274 DEBUG [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1 2023-02-15 23:01:08,274 INFO [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b66ad5c51d40cceb1755ffa12528a48 columnFamilyName f1 2023-02-15 23:01:08,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:08,276 INFO [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] regionserver.HStore(310): Store=7b66ad5c51d40cceb1755ffa12528a48/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,276 INFO [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:08,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-15 23:01:08,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure 9c651e4cdd5d3eb51ce657623e66c7db, server=jenkins-hbase4.apache.org,43695,1676502063240 in 282 msec 2023-02-15 23:01:08,279 DEBUG [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2 2023-02-15 23:01:08,279 DEBUG [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2 2023-02-15 23:01:08,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9c651e4cdd5d3eb51ce657623e66c7db, ASSIGN in 462 msec 2023-02-15 23:01:08,280 INFO [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b66ad5c51d40cceb1755ffa12528a48 columnFamilyName f2 2023-02-15 23:01:08,281 INFO [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] regionserver.HStore(310): Store=7b66ad5c51d40cceb1755ffa12528a48/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:08,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:08,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:08,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a1f5cc5d6ade79c61316452d39fcdd7b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70489711, jitterRate=0.05037854611873627}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:08,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a1f5cc5d6ade79c61316452d39fcdd7b: 2023-02-15 23:01:08,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b., pid=27, masterSystemTime=1676502068150 2023-02-15 23:01:08,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:08,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:08,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:08,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:08,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0190671bf7339a24b5cfb6398a4cd63d, NAME => 'testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-15 23:01:08,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:08,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:08,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:08,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:08,292 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=a1f5cc5d6ade79c61316452d39fcdd7b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:08,293 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502068292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502068292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502068292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502068292"}]},"ts":"1676502068292"} 2023-02-15 23:01:08,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:08,296 INFO [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:08,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:08,299 DEBUG [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1 2023-02-15 23:01:08,299 DEBUG [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1 2023-02-15 23:01:08,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7b66ad5c51d40cceb1755ffa12528a48; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69500175, jitterRate=0.03563331067562103}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:08,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=18 2023-02-15 23:01:08,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7b66ad5c51d40cceb1755ffa12528a48: 2023-02-15 23:01:08,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=18, state=SUCCESS; OpenRegionProcedure a1f5cc5d6ade79c61316452d39fcdd7b, server=jenkins-hbase4.apache.org,33507,1676502063190 in 296 msec 2023-02-15 23:01:08,300 INFO [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0190671bf7339a24b5cfb6398a4cd63d columnFamilyName f1 2023-02-15 23:01:08,301 INFO [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] regionserver.HStore(310): Store=0190671bf7339a24b5cfb6398a4cd63d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48., pid=22, masterSystemTime=1676502068137 2023-02-15 23:01:08,301 INFO [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:08,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a1f5cc5d6ade79c61316452d39fcdd7b, ASSIGN in 485 msec 2023-02-15 23:01:08,304 DEBUG [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2 2023-02-15 23:01:08,304 DEBUG [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2 2023-02-15 23:01:08,305 INFO [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0190671bf7339a24b5cfb6398a4cd63d columnFamilyName f2 2023-02-15 23:01:08,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:08,305 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7b66ad5c51d40cceb1755ffa12528a48, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:08,305 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502068305"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502068305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502068305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502068305"}]},"ts":"1676502068305"} 2023-02-15 23:01:08,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:08,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:08,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 72bd5387fbbb2a758e40270a96f8650e, NAME => 'testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-15 23:01:08,306 INFO [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] regionserver.HStore(310): Store=0190671bf7339a24b5cfb6398a4cd63d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:08,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:08,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:08,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:08,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:08,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:08,310 INFO [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:08,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-02-15 23:01:08,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:08,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; OpenRegionProcedure 7b66ad5c51d40cceb1755ffa12528a48, server=jenkins-hbase4.apache.org,43695,1676502063240 in 322 msec 2023-02-15 23:01:08,313 DEBUG [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1 2023-02-15 23:01:08,313 DEBUG [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1 2023-02-15 23:01:08,314 INFO [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72bd5387fbbb2a758e40270a96f8650e columnFamilyName f1 2023-02-15 23:01:08,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:08,315 INFO [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] regionserver.HStore(310): Store=72bd5387fbbb2a758e40270a96f8650e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,315 INFO [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:08,315 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7b66ad5c51d40cceb1755ffa12528a48, ASSIGN in 498 msec 2023-02-15 23:01:08,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:08,318 DEBUG [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2 2023-02-15 23:01:08,318 DEBUG [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2 2023-02-15 23:01:08,318 INFO [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72bd5387fbbb2a758e40270a96f8650e columnFamilyName f2 2023-02-15 23:01:08,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0190671bf7339a24b5cfb6398a4cd63d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62674544, jitterRate=-0.06607651710510254}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:08,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0190671bf7339a24b5cfb6398a4cd63d: 2023-02-15 23:01:08,320 INFO [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] regionserver.HStore(310): Store=72bd5387fbbb2a758e40270a96f8650e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d., pid=26, masterSystemTime=1676502068150 2023-02-15 23:01:08,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:08,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:08,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:08,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:08,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:08,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7bda59cbbe289d53689c842d819b62fe, NAME => 'testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-15 23:01:08,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:08,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:08,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:08,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:08,325 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0190671bf7339a24b5cfb6398a4cd63d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:08,325 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502068325"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502068325"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502068325"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502068325"}]},"ts":"1676502068325"} 2023-02-15 23:01:08,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:08,331 INFO [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:08,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-15 23:01:08,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure 0190671bf7339a24b5cfb6398a4cd63d, server=jenkins-hbase4.apache.org,33507,1676502063190 in 331 msec 2023-02-15 23:01:08,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0190671bf7339a24b5cfb6398a4cd63d, ASSIGN in 516 msec 2023-02-15 23:01:08,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:08,334 DEBUG [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe/f1 2023-02-15 23:01:08,334 DEBUG [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe/f1 2023-02-15 23:01:08,335 INFO [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7bda59cbbe289d53689c842d819b62fe columnFamilyName f1 2023-02-15 23:01:08,336 INFO [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] regionserver.HStore(310): Store=7bda59cbbe289d53689c842d819b62fe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,336 INFO [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:08,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:08,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 72bd5387fbbb2a758e40270a96f8650e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68217671, jitterRate=0.016522511839866638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:08,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 72bd5387fbbb2a758e40270a96f8650e: 2023-02-15 23:01:08,338 DEBUG [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe/f2 2023-02-15 23:01:08,338 DEBUG [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe/f2 2023-02-15 23:01:08,338 INFO [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7bda59cbbe289d53689c842d819b62fe columnFamilyName f2 2023-02-15 23:01:08,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e., pid=23, masterSystemTime=1676502068137 2023-02-15 23:01:08,339 INFO [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] regionserver.HStore(310): Store=7bda59cbbe289d53689c842d819b62fe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:08,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:08,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:08,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:08,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:08,342 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=72bd5387fbbb2a758e40270a96f8650e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:08,342 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502068342"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502068342"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502068342"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502068342"}]},"ts":"1676502068342"} 2023-02-15 23:01:08,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:08,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:08,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:08,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:08,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7bda59cbbe289d53689c842d819b62fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61908028, jitterRate=-0.07749849557876587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:08,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7bda59cbbe289d53689c842d819b62fe: 2023-02-15 23:01:08,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe., pid=30, masterSystemTime=1676502068150 2023-02-15 23:01:08,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=16 2023-02-15 23:01:08,354 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=16, state=SUCCESS; OpenRegionProcedure 72bd5387fbbb2a758e40270a96f8650e, server=jenkins-hbase4.apache.org,43695,1676502063240 in 362 msec 2023-02-15 23:01:08,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:08,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=72bd5387fbbb2a758e40270a96f8650e, ASSIGN in 538 msec 2023-02-15 23:01:08,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:08,357 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7bda59cbbe289d53689c842d819b62fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:08,357 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502068357"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502068357"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502068357"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502068357"}]},"ts":"1676502068357"} 2023-02-15 23:01:08,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=20 2023-02-15 23:01:08,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=20, state=SUCCESS; OpenRegionProcedure 7bda59cbbe289d53689c842d819b62fe, server=jenkins-hbase4.apache.org,33507,1676502063190 in 352 msec 2023-02-15 23:01:08,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=10 2023-02-15 23:01:08,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7bda59cbbe289d53689c842d819b62fe, ASSIGN in 547 msec 2023-02-15 23:01:08,367 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:08,367 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502068367"}]},"ts":"1676502068367"} 2023-02-15 23:01:08,369 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-15 23:01:08,373 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:08,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.1700 sec 2023-02-15 23:01:09,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:09,353 INFO [Listener at localhost/40123] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-15 23:01:09,353 DEBUG [Listener at localhost/40123] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-15 23:01:09,356 INFO [Listener at localhost/40123] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:09,364 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-15 23:01:09,365 INFO [Listener at localhost/40123] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:09,365 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-15 23:01:09,365 INFO [Listener at localhost/40123] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 23:01:09,490 DEBUG [hconnection-0x1f92f1d8-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:09,551 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53834, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:09,597 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:09,600 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43695] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:09,887 INFO [Listener at localhost/40123] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 23:01:09,891 INFO [Listener at localhost/40123] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 23:01:09,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 23:01:09,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676502069906 (current time:1676502069906). 2023-02-15 23:01:09,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 23:01:09,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] zookeeper.ReadOnlyZKClient(139): Connect 0x62e6b70d to 127.0.0.1:64794 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:09,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@291505d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:09,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:09,922 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60012, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:09,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62e6b70d to 127.0.0.1:64794 2023-02-15 23:01:09,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:09,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 23:01:09,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 23:01:09,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 23:01:09,947 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 23:01:09,949 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676502669949 2023-02-15 23:01:09,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 23:01:09,950 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-15 23:01:09,952 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 23:01:09,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 23:01:09,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 13 msec 2023-02-15 23:01:09,955 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 23:01:09,955 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:09,955 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 23:01:09,956 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676502669956 2023-02-15 23:01:09,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-15 23:01:09,988 INFO [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-15 23:01:09,988 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:09,989 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-15 23:01:09,989 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-15 23:01:10,026 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:10,026 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 23:01:10,030 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:10,030 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:10,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:10,030 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:10,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:10,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:10,031 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 23:01:10,031 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 23:01:10,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:10,032 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:10,032 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:10,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-15 23:01:10,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 23:01:10,033 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 23:01:10,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:10,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-15 23:01:10,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 23:01:10,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-15 23:01:10,036 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 23:01:10,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-15 23:01:10,037 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-15 23:01:10,037 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:10,038 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 23:01:10,038 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-15 23:01:10,038 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:10,038 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-15 23:01:10,038 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 23:01:10,038 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-15 23:01:10,038 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33507,1676502063190' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-15 23:01:10,038 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43695,1676502063240' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-15 23:01:10,041 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 23:01:10,041 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 23:01:10,041 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:10,041 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:10,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:10,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:10,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:10,042 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 23:01:10,042 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:10,042 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 23:01:10,042 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:10,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:10,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:10,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 23:01:10,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:10,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43695,1676502063240' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-15 23:01:10,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d5d7f20[Count = 1] remaining members to acquire global barrier 2023-02-15 23:01:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 23:01:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:10,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33507,1676502063190' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-15 23:01:10,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d5d7f20[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:10,048 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-15 23:01:10,048 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 23:01:10,050 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 23:01:10,050 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 23:01:10,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 23:01:10,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 23:01:10,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 23:01:10,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 23:01:10,050 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 23:01:10,050 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 23:01:10,050 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:10,051 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:10,051 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:10,051 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:10,051 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:10,051 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:10,051 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 23:01:10,051 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:10,051 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 23:01:10,051 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:10,052 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. started... 2023-02-15 23:01:10,052 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. started... 2023-02-15 23:01:10,052 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. started... 2023-02-15 23:01:10,052 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. started... 2023-02-15 23:01:10,052 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. started... 2023-02-15 23:01:10,055 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:10,056 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 23:01:10,056 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 23:01:10,056 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 7b66ad5c51d40cceb1755ffa12528a48 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 23:01:10,058 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7c06162354c42cfe1212016459f5e936: 2023-02-15 23:01:10,059 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d6f280ccad96b13bef3dc4771819bf8e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:10,059 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,056 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:10,057 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 225454195a3f647766b594b547f3a978 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:10,056 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0190671bf7339a24b5cfb6398a4cd63d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:10,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 23:01:10,059 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. started... 2023-02-15 23:01:10,060 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HRegion(2744): Flushing cc38f1967537aa31f1fc74a629715aa4 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 23:01:10,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 23:01:10,062 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 23:01:10,065 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:10,068 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 23:01:10,068 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 23:01:10,097 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. completed. 2023-02-15 23:01:10,097 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:10,098 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:10,098 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 23:01:10,098 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. started... 2023-02-15 23:01:10,099 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 72bd5387fbbb2a758e40270a96f8650e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:10,263 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:10,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 23:01:10,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 23:01:10,268 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/.tmp/f1/bc914479923e42d5b72cb3f4395911d7 2023-02-15 23:01:10,268 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-15 23:01:10,278 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/.tmp/f1/4465ed22c30846bc95e9fa4b84efb506 2023-02-15 23:01:10,286 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/.tmp/f1/1fa4fb006e8941d6bd9c5f8bfa9a1474 2023-02-15 23:01:10,286 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/.tmp/f1/02112c01ef91447b8eb6f016f3847db5 2023-02-15 23:01:10,301 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/.tmp/f1/3b45952c3eea4b4a95fbdb57a8f2a5f8 2023-02-15 23:01:10,301 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/.tmp/f1/a9c49f4300a74a588ee9862477220246 2023-02-15 23:01:10,395 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/.tmp/f2/404d427613f84a5c9709d2f1351b13e8 2023-02-15 23:01:10,398 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/.tmp/f2/116df80b481040209a468ec293bb0062 2023-02-15 23:01:10,407 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/.tmp/f1/1fa4fb006e8941d6bd9c5f8bfa9a1474 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1/1fa4fb006e8941d6bd9c5f8bfa9a1474 2023-02-15 23:01:10,410 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/.tmp/f1/3b45952c3eea4b4a95fbdb57a8f2a5f8 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1/3b45952c3eea4b4a95fbdb57a8f2a5f8 2023-02-15 23:01:10,412 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/.tmp/f2/4015f18eded6481bbf248af727530a82 2023-02-15 23:01:10,423 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1/1fa4fb006e8941d6bd9c5f8bfa9a1474, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:10,425 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1/3b45952c3eea4b4a95fbdb57a8f2a5f8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:10,433 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/.tmp/f2/404d427613f84a5c9709d2f1351b13e8 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2/404d427613f84a5c9709d2f1351b13e8 2023-02-15 23:01:10,436 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/.tmp/f2/116df80b481040209a468ec293bb0062 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2/116df80b481040209a468ec293bb0062 2023-02-15 23:01:10,438 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/.tmp/f2/9e3ba430180c4bff9e1e43b01ea1ef19 2023-02-15 23:01:10,438 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/.tmp/f1/4465ed22c30846bc95e9fa4b84efb506 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1/4465ed22c30846bc95e9fa4b84efb506 2023-02-15 23:01:10,443 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/.tmp/f2/f897140349d243fba8812ff6aebdc384 2023-02-15 23:01:10,445 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/.tmp/f2/635f502302ff413fa8ea08bc7378ab60 2023-02-15 23:01:10,450 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2/404d427613f84a5c9709d2f1351b13e8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:10,454 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0190671bf7339a24b5cfb6398a4cd63d in 398ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:10,456 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-15 23:01:10,456 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1/4465ed22c30846bc95e9fa4b84efb506, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 23:01:10,457 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/.tmp/f1/a9c49f4300a74a588ee9862477220246 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1/a9c49f4300a74a588ee9862477220246 2023-02-15 23:01:10,458 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/.tmp/f1/02112c01ef91447b8eb6f016f3847db5 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1/02112c01ef91447b8eb6f016f3847db5 2023-02-15 23:01:10,458 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/.tmp/f2/4015f18eded6481bbf248af727530a82 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2/4015f18eded6481bbf248af727530a82 2023-02-15 23:01:10,459 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0190671bf7339a24b5cfb6398a4cd63d: 2023-02-15 23:01:10,459 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,459 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:10,460 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1/1fa4fb006e8941d6bd9c5f8bfa9a1474] hfiles 2023-02-15 23:01:10,460 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1/1fa4fb006e8941d6bd9c5f8bfa9a1474 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,462 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2/116df80b481040209a468ec293bb0062, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:10,464 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d6f280ccad96b13bef3dc4771819bf8e in 405ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:10,468 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2/404d427613f84a5c9709d2f1351b13e8] hfiles 2023-02-15 23:01:10,468 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2/404d427613f84a5c9709d2f1351b13e8 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,473 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d6f280ccad96b13bef3dc4771819bf8e: 2023-02-15 23:01:10,474 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,475 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:10,475 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1/3b45952c3eea4b4a95fbdb57a8f2a5f8] hfiles 2023-02-15 23:01:10,475 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1/3b45952c3eea4b4a95fbdb57a8f2a5f8 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,475 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/.tmp/f1/bc914479923e42d5b72cb3f4395911d7 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1/bc914479923e42d5b72cb3f4395911d7 2023-02-15 23:01:10,475 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2/116df80b481040209a468ec293bb0062] hfiles 2023-02-15 23:01:10,476 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1/a9c49f4300a74a588ee9862477220246, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:10,476 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2/116df80b481040209a468ec293bb0062 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,477 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1/02112c01ef91447b8eb6f016f3847db5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:10,478 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/.tmp/f2/f897140349d243fba8812ff6aebdc384 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2/f897140349d243fba8812ff6aebdc384 2023-02-15 23:01:10,479 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2/4015f18eded6481bbf248af727530a82, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 23:01:10,479 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/.tmp/f2/635f502302ff413fa8ea08bc7378ab60 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2/635f502302ff413fa8ea08bc7378ab60 2023-02-15 23:01:10,480 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for cc38f1967537aa31f1fc74a629715aa4 in 420ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:10,480 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for cc38f1967537aa31f1fc74a629715aa4: 2023-02-15 23:01:10,480 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,480 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:10,481 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1/4465ed22c30846bc95e9fa4b84efb506] hfiles 2023-02-15 23:01:10,481 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1/4465ed22c30846bc95e9fa4b84efb506 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,481 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2/4015f18eded6481bbf248af727530a82] hfiles 2023-02-15 23:01:10,481 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2/4015f18eded6481bbf248af727530a82 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,493 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1/bc914479923e42d5b72cb3f4395911d7, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 23:01:10,494 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2/f897140349d243fba8812ff6aebdc384, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:10,494 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2/635f502302ff413fa8ea08bc7378ab60, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:10,495 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 72bd5387fbbb2a758e40270a96f8650e in 396ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:10,495 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 225454195a3f647766b594b547f3a978 in 439ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:10,495 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 72bd5387fbbb2a758e40270a96f8650e: 2023-02-15 23:01:10,495 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 225454195a3f647766b594b547f3a978: 2023-02-15 23:01:10,496 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,496 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,496 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/.tmp/f2/9e3ba430180c4bff9e1e43b01ea1ef19 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2/9e3ba430180c4bff9e1e43b01ea1ef19 2023-02-15 23:01:10,496 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:10,496 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:10,496 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1/02112c01ef91447b8eb6f016f3847db5] hfiles 2023-02-15 23:01:10,496 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1/a9c49f4300a74a588ee9862477220246] hfiles 2023-02-15 23:01:10,496 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1/02112c01ef91447b8eb6f016f3847db5 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,496 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1/a9c49f4300a74a588ee9862477220246 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,496 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2/635f502302ff413fa8ea08bc7378ab60] hfiles 2023-02-15 23:01:10,496 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2/f897140349d243fba8812ff6aebdc384] hfiles 2023-02-15 23:01:10,496 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2/635f502302ff413fa8ea08bc7378ab60 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,496 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2/f897140349d243fba8812ff6aebdc384 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,517 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. completed. 2023-02-15 23:01:10,517 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:10,518 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:10,518 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 23:01:10,518 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. started... 2023-02-15 23:01:10,521 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HRegion(2744): Flushing a1f5cc5d6ade79c61316452d39fcdd7b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:10,531 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2/9e3ba430180c4bff9e1e43b01ea1ef19, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 23:01:10,535 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. completed. 2023-02-15 23:01:10,535 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:10,535 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:10,536 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. started... 2023-02-15 23:01:10,536 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 23:01:10,538 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 7b66ad5c51d40cceb1755ffa12528a48 in 482ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:10,539 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 7b66ad5c51d40cceb1755ffa12528a48: 2023-02-15 23:01:10,540 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,540 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:10,540 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1/bc914479923e42d5b72cb3f4395911d7] hfiles 2023-02-15 23:01:10,540 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1/bc914479923e42d5b72cb3f4395911d7 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,540 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2/9e3ba430180c4bff9e1e43b01ea1ef19] hfiles 2023-02-15 23:01:10,540 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2/9e3ba430180c4bff9e1e43b01ea1ef19 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,539 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9c651e4cdd5d3eb51ce657623e66c7db 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:10,553 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. completed. 2023-02-15 23:01:10,560 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:10,560 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:10,560 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 23:01:10,561 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. started... 2023-02-15 23:01:10,566 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7bda59cbbe289d53689c842d819b62fe: 2023-02-15 23:01:10,567 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,567 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:10,567 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 23:01:10,567 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 23:01:10,572 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:10,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 23:01:10,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 23:01:10,575 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-15 23:01:10,588 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. completed. 2023-02-15 23:01:10,588 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:10,588 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 23:01:10,603 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. completed. 2023-02-15 23:01:10,604 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:10,604 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 23:01:10,605 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/.tmp/f1/85a53ec5ceb94c8489ce88dc8687eb4f 2023-02-15 23:01:10,631 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/.tmp/f2/af2c4783862c4ff79efe7be3228ed9ae 2023-02-15 23:01:10,642 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/.tmp/f1/85a53ec5ceb94c8489ce88dc8687eb4f as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1/85a53ec5ceb94c8489ce88dc8687eb4f 2023-02-15 23:01:10,650 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1/85a53ec5ceb94c8489ce88dc8687eb4f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:10,652 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/.tmp/f2/af2c4783862c4ff79efe7be3228ed9ae as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2/af2c4783862c4ff79efe7be3228ed9ae 2023-02-15 23:01:10,660 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2/af2c4783862c4ff79efe7be3228ed9ae, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:10,662 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9c651e4cdd5d3eb51ce657623e66c7db in 123ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:10,662 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9c651e4cdd5d3eb51ce657623e66c7db: 2023-02-15 23:01:10,662 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,662 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:10,662 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1/85a53ec5ceb94c8489ce88dc8687eb4f] hfiles 2023-02-15 23:01:10,662 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1/85a53ec5ceb94c8489ce88dc8687eb4f for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,662 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2/af2c4783862c4ff79efe7be3228ed9ae] hfiles 2023-02-15 23:01:10,662 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2/af2c4783862c4ff79efe7be3228ed9ae for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:10,674 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. completed. 2023-02-15 23:01:10,675 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:10,675 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 23:01:10,975 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. completed. 2023-02-15 23:01:10,976 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:10,976 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 23:01:10,978 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. completed. 2023-02-15 23:01:10,978 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:10,978 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 23:01:10,978 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 23:01:10,978 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:10,979 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-15 23:01:10,979 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43695,1676502063240' in zk 2023-02-15 23:01:10,982 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:10,982 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-15 23:01:10,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:10,982 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:10,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:10,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:10,983 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-15 23:01:10,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:10,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:10,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 23:01:10,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:10,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:10,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:10,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 23:01:10,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:10,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43695,1676502063240': 2023-02-15 23:01:10,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43695,1676502063240' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 23:01:11,004 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/.tmp/f1/8ae2a75d0b3b4080af7e48bd38e39251 2023-02-15 23:01:11,029 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/.tmp/f2/41750b51618b49e5a878b9cbbc527d25 2023-02-15 23:01:11,037 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/.tmp/f1/8ae2a75d0b3b4080af7e48bd38e39251 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1/8ae2a75d0b3b4080af7e48bd38e39251 2023-02-15 23:01:11,044 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1/8ae2a75d0b3b4080af7e48bd38e39251, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:11,045 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/.tmp/f2/41750b51618b49e5a878b9cbbc527d25 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2/41750b51618b49e5a878b9cbbc527d25 2023-02-15 23:01:11,052 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2/41750b51618b49e5a878b9cbbc527d25, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:11,053 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a1f5cc5d6ade79c61316452d39fcdd7b in 533ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:11,054 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a1f5cc5d6ade79c61316452d39fcdd7b: 2023-02-15 23:01:11,054 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:11,054 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:11,054 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1/8ae2a75d0b3b4080af7e48bd38e39251] hfiles 2023-02-15 23:01:11,054 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1/8ae2a75d0b3b4080af7e48bd38e39251 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:11,054 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2/41750b51618b49e5a878b9cbbc527d25] hfiles 2023-02-15 23:01:11,054 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2/41750b51618b49e5a878b9cbbc527d25 for snapshot=testWithMapReduceMultiRegion 2023-02-15 23:01:11,062 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. completed. 2023-02-15 23:01:11,062 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:11,062 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 23:01:11,063 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 23:01:11,063 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:11,063 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-15 23:01:11,063 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33507,1676502063190' in zk 2023-02-15 23:01:11,066 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-15 23:01:11,066 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:11,066 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:11,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:11,066 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-15 23:01:11,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:11,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:11,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:11,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:11,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 23:01:11,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:11,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:11,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:11,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 23:01:11,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:11,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:11,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33507,1676502063190': 2023-02-15 23:01:11,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33507,1676502063190' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 23:01:11,072 INFO [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-15 23:01:11,072 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:11,072 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:11,072 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-15 23:01:11,072 INFO [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 23:01:11,075 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:11,075 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:11,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:11,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:11,075 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:11,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:11,075 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:11,075 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:11,075 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:11,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:11,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:11,076 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:11,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:11,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:11,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:11,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:11,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:11,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:11,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:11,077 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:11,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:11,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 23:01:11,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 23:01:11,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:11,077 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-15 23:01:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 23:01:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 23:01:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:11,079 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:11,080 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:11,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:11,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 23:01:11,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:11,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:11,092 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:11,092 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:11,093 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 23:01:11,092 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:11,093 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:11,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:11,093 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:11,093 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:11,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:11,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:11,093 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 23:01:11,093 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:11,093 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-15 23:01:11,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-15 23:01:11,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:11,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:11,094 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:11,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:11,096 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 23:01:11,096 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:11,096 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 23:01:11,096 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 23:01:11,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:11,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-15 23:01:11,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-15 23:01:11,223 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-15 23:01:11,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-15 23:01:11,223 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-15 23:01:11,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676502069950Consolidate snapshot: testWithMapReduceMultiRegion at 1676502071094 (+1144 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676502071094Writing data manifest for testWithMapReduceMultiRegion at 1676502071122 (+28 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676502071159 (+37 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676502071223 (+64 ms) 2023-02-15 23:01:11,225 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 23:01:11,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2740 sec 2023-02-15 23:01:11,655 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-15 23:01:11,721 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-15 23:01:11,723 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-15 23:01:12,078 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:12,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 23:01:12,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 23:01:12,080 INFO [Listener at localhost/40123] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 23:01:12,090 INFO [Listener at localhost/40123] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 23:01:12,102 INFO [Listener at localhost/40123] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 23:01:12,143 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 23:01:12,144 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-15 23:01:12,213 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43695] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:12,213 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:12,366 INFO [Listener at localhost/40123] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 23:01:12,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 23:01:12,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-15 23:01:12,389 INFO [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-15 23:01:12,389 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:12,390 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-15 23:01:12,390 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-15 23:01:12,391 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:12,391 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:12,416 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:12,416 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:12,416 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:12,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:12,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:12,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:12,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:12,417 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:12,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:12,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:12,417 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:12,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:12,418 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:12,418 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:12,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:12,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:12,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:12,418 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 23:01:12,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:12,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:12,419 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 23:01:12,420 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 23:01:12,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 23:01:12,421 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 23:01:12,421 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:12,421 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 23:01:12,422 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 23:01:12,422 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:12,422 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 23:01:12,423 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:12,423 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. started... 2023-02-15 23:01:12,424 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d6f280ccad96b13bef3dc4771819bf8e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:12,424 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:12,424 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. started... 2023-02-15 23:01:12,424 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0190671bf7339a24b5cfb6398a4cd63d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:12,425 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 23:01:12,425 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 23:01:12,425 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:12,425 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:12,425 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. started... 2023-02-15 23:01:12,425 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. started... 2023-02-15 23:01:12,425 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7c06162354c42cfe1212016459f5e936: 2023-02-15 23:01:12,425 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7b66ad5c51d40cceb1755ffa12528a48 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 23:01:12,425 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:12,426 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:12,426 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. started... 2023-02-15 23:01:12,426 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 225454195a3f647766b594b547f3a978 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:12,426 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 23:01:12,426 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 23:01:12,426 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:12,427 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 23:01:12,427 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:12,427 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. started... 2023-02-15 23:01:12,428 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. started... 2023-02-15 23:01:12,433 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 72bd5387fbbb2a758e40270a96f8650e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:12,433 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cc38f1967537aa31f1fc74a629715aa4 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 23:01:12,507 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/.tmp/f1/ba09f79cf52948f3885ab7e9c8ab7eb8 2023-02-15 23:01:12,510 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/.tmp/f1/2ae95eaceeba40c6a0f6915d44d52112 2023-02-15 23:01:12,511 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/.tmp/f1/5e81e10c20954293a732838867597b56 2023-02-15 23:01:12,512 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/.tmp/f1/c901e0ad9af4405a9bfde06a8f890e7c 2023-02-15 23:01:12,513 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/.tmp/f1/fd3361d75fd34cd48ba322ac2a3492a8 2023-02-15 23:01:12,552 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/.tmp/f2/eb8cd72469984e7491a6e05e4a2a019a 2023-02-15 23:01:12,560 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/.tmp/f1/c901e0ad9af4405a9bfde06a8f890e7c as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1/c901e0ad9af4405a9bfde06a8f890e7c 2023-02-15 23:01:12,560 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/.tmp/f2/2d672bc6a82742caa20ce60dbb33d641 2023-02-15 23:01:12,568 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1/c901e0ad9af4405a9bfde06a8f890e7c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:12,568 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/.tmp/f2/3ae3b1dcd9354bd6a6e5b12ba63ca1b1 2023-02-15 23:01:12,569 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/.tmp/f2/53dc0e8aa1924718850e90b7adc0637a 2023-02-15 23:01:12,569 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/.tmp/f2/eb8cd72469984e7491a6e05e4a2a019a as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2/eb8cd72469984e7491a6e05e4a2a019a 2023-02-15 23:01:12,570 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/.tmp/f1/fd3361d75fd34cd48ba322ac2a3492a8 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1/fd3361d75fd34cd48ba322ac2a3492a8 2023-02-15 23:01:12,572 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/.tmp/f2/838354c97f5c42a8aef40cfe7b093743 2023-02-15 23:01:12,577 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/.tmp/f1/2ae95eaceeba40c6a0f6915d44d52112 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1/2ae95eaceeba40c6a0f6915d44d52112 2023-02-15 23:01:12,577 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/.tmp/f1/ba09f79cf52948f3885ab7e9c8ab7eb8 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1/ba09f79cf52948f3885ab7e9c8ab7eb8 2023-02-15 23:01:12,579 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1/fd3361d75fd34cd48ba322ac2a3492a8, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 23:01:12,579 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2/eb8cd72469984e7491a6e05e4a2a019a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:12,581 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/.tmp/f2/2d672bc6a82742caa20ce60dbb33d641 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2/2d672bc6a82742caa20ce60dbb33d641 2023-02-15 23:01:12,581 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d6f280ccad96b13bef3dc4771819bf8e in 158ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:12,582 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d6f280ccad96b13bef3dc4771819bf8e: 2023-02-15 23:01:12,582 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:12,582 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:12,582 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 23:01:12,582 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. started... 2023-02-15 23:01:12,582 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9c651e4cdd5d3eb51ce657623e66c7db 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:12,588 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/.tmp/f1/5e81e10c20954293a732838867597b56 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1/5e81e10c20954293a732838867597b56 2023-02-15 23:01:12,588 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1/2ae95eaceeba40c6a0f6915d44d52112, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:12,589 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1/ba09f79cf52948f3885ab7e9c8ab7eb8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:12,590 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/.tmp/f2/53dc0e8aa1924718850e90b7adc0637a as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2/53dc0e8aa1924718850e90b7adc0637a 2023-02-15 23:01:12,590 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/.tmp/f2/3ae3b1dcd9354bd6a6e5b12ba63ca1b1 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2/3ae3b1dcd9354bd6a6e5b12ba63ca1b1 2023-02-15 23:01:12,591 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2/2d672bc6a82742caa20ce60dbb33d641, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 23:01:12,593 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 7b66ad5c51d40cceb1755ffa12528a48 in 168ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:12,593 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7b66ad5c51d40cceb1755ffa12528a48: 2023-02-15 23:01:12,593 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:12,593 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 23:01:12,598 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2/3ae3b1dcd9354bd6a6e5b12ba63ca1b1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:12,599 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 225454195a3f647766b594b547f3a978 in 173ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:12,599 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 225454195a3f647766b594b547f3a978: 2023-02-15 23:01:12,599 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:12,600 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:12,600 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 23:01:12,600 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. started... 2023-02-15 23:01:12,600 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a1f5cc5d6ade79c61316452d39fcdd7b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:12,602 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1/5e81e10c20954293a732838867597b56, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:12,603 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/.tmp/f2/838354c97f5c42a8aef40cfe7b093743 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2/838354c97f5c42a8aef40cfe7b093743 2023-02-15 23:01:12,610 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2/53dc0e8aa1924718850e90b7adc0637a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:12,611 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 72bd5387fbbb2a758e40270a96f8650e in 179ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:12,612 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 72bd5387fbbb2a758e40270a96f8650e: 2023-02-15 23:01:12,612 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:12,612 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 23:01:12,613 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2/838354c97f5c42a8aef40cfe7b093743, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:12,614 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0190671bf7339a24b5cfb6398a4cd63d in 190ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:12,614 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0190671bf7339a24b5cfb6398a4cd63d: 2023-02-15 23:01:12,614 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:12,614 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:12,614 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 23:01:12,614 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. started... 2023-02-15 23:01:12,614 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7bda59cbbe289d53689c842d819b62fe: 2023-02-15 23:01:12,614 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:12,614 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 23:01:12,621 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/.tmp/f1/55a4ca86039244b5ac6339e275c8a396 2023-02-15 23:01:12,628 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/.tmp/f1/b0ac0e8ee7ff4f36bc555b638b1e2719 2023-02-15 23:01:12,916 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/.tmp/f1/04cab5f109734c35a72b09a6df76ebae 2023-02-15 23:01:12,932 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/.tmp/f2/dceaf231bb4745fbbb11762addabdb09 2023-02-15 23:01:12,938 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/.tmp/f1/04cab5f109734c35a72b09a6df76ebae as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1/04cab5f109734c35a72b09a6df76ebae 2023-02-15 23:01:12,945 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1/04cab5f109734c35a72b09a6df76ebae, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 23:01:12,946 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/.tmp/f2/dceaf231bb4745fbbb11762addabdb09 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2/dceaf231bb4745fbbb11762addabdb09 2023-02-15 23:01:12,951 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2/dceaf231bb4745fbbb11762addabdb09, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 23:01:12,952 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for cc38f1967537aa31f1fc74a629715aa4 in 524ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:12,953 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cc38f1967537aa31f1fc74a629715aa4: 2023-02-15 23:01:12,953 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:12,953 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 23:01:13,054 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/.tmp/f2/8c0b5ab95cbb48558beaebb423a36ca5 2023-02-15 23:01:13,055 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/.tmp/f2/2a47e913b2db434b9dfca22892ea5d2c 2023-02-15 23:01:13,066 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/.tmp/f1/55a4ca86039244b5ac6339e275c8a396 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1/55a4ca86039244b5ac6339e275c8a396 2023-02-15 23:01:13,068 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/.tmp/f1/b0ac0e8ee7ff4f36bc555b638b1e2719 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1/b0ac0e8ee7ff4f36bc555b638b1e2719 2023-02-15 23:01:13,077 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1/55a4ca86039244b5ac6339e275c8a396, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:13,078 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/.tmp/f2/2a47e913b2db434b9dfca22892ea5d2c as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2/2a47e913b2db434b9dfca22892ea5d2c 2023-02-15 23:01:13,081 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1/b0ac0e8ee7ff4f36bc555b638b1e2719, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:13,082 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/.tmp/f2/8c0b5ab95cbb48558beaebb423a36ca5 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2/8c0b5ab95cbb48558beaebb423a36ca5 2023-02-15 23:01:13,085 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2/2a47e913b2db434b9dfca22892ea5d2c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:13,087 INFO [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9c651e4cdd5d3eb51ce657623e66c7db in 505ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:13,087 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9c651e4cdd5d3eb51ce657623e66c7db: 2023-02-15 23:01:13,087 DEBUG [rs(jenkins-hbase4.apache.org,43695,1676502063240)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:13,087 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 23:01:13,087 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 23:01:13,087 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,087 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 23:01:13,087 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43695,1676502063240' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 23:01:13,089 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2/8c0b5ab95cbb48558beaebb423a36ca5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:13,090 INFO [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a1f5cc5d6ade79c61316452d39fcdd7b in 490ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:13,090 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a1f5cc5d6ade79c61316452d39fcdd7b: 2023-02-15 23:01:13,090 DEBUG [rs(jenkins-hbase4.apache.org,33507,1676502063190)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:13,090 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 23:01:13,090 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 23:01:13,090 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,090 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 23:01:13,090 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33507,1676502063190' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 23:01:13,094 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,094 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:13,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:13,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:13,095 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,095 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:13,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:13,096 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:13,096 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:13,104 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:13,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:13,104 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:13,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:13,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:13,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43695,1676502063240' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 23:01:13,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21ee396d[Count = 1] remaining members to acquire global barrier 2023-02-15 23:01:13,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:13,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:13,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:13,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:13,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:13,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:13,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33507,1676502063190' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 23:01:13,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21ee396d[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:13,109 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-15 23:01:13,109 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:13,112 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:13,112 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:13,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:13,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:13,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:13,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:13,112 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 23:01:13,112 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 23:01:13,112 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,112 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 23:01:13,112 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 23:01:13,112 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,33507,1676502063190' in zk 2023-02-15 23:01:13,112 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,43695,1676502063240' in zk 2023-02-15 23:01:13,112 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,113 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:13,115 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,115 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 23:01:13,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:13,116 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:13,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:13,116 DEBUG [member: 'jenkins-hbase4.apache.org,33507,1676502063190' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 23:01:13,117 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,117 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 23:01:13,117 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:13,117 DEBUG [member: 'jenkins-hbase4.apache.org,43695,1676502063240' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 23:01:13,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:13,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:13,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:13,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:13,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:13,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,33507,1676502063190': 2023-02-15 23:01:13,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33507,1676502063190' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-15 23:01:13,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:13,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:13,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:13,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:13,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:13,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:13,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:13,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,43695,1676502063240': 2023-02-15 23:01:13,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43695,1676502063240' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-15 23:01:13,126 INFO [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-15 23:01:13,126 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:13,126 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:13,126 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-15 23:01:13,126 INFO [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 23:01:13,128 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:13,128 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:13,128 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:13,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:13,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:13,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:13,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:13,128 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:13,128 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:13,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:13,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:13,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:13,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:13,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:13,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:13,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:13,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:13,129 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:13,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:13,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:13,130 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:13,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:13,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,132 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:13,133 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:13,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,139 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,139 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:13,139 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:13,139 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:13,139 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:13,139 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:13,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:13,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:13,139 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,140 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:13,140 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:13,140 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:13,140 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:13,140 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:13,140 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:13,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-15 23:01:13,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 23:01:13,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:13,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:13,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:13,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:13,139 DEBUG [(jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:13,142 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:13,143 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 23:01:13,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:13,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:13,243 DEBUG [Listener at localhost/40123] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 23:01:13,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 23:01:13,366 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/hadoop-3556061577536369197.jar 2023-02-15 23:01:13,383 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676502069906 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:13,384 DEBUG [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce 2023-02-15 23:01:13,385 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(239): region to add: d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:13,385 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(239): region to add: 0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:13,385 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(239): region to add: 7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:13,385 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(239): region to add: 225454195a3f647766b594b547f3a978 2023-02-15 23:01:13,385 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(239): region to add: 7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:13,385 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(239): region to add: 72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:13,385 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(239): region to add: 9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:13,386 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(239): region to add: cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:13,386 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(239): region to add: a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:13,386 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(239): region to add: 7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:13,386 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(585): clone region=d6f280ccad96b13bef3dc4771819bf8e as d6f280ccad96b13bef3dc4771819bf8e in snapshot testWithMapReduceMultiRegion 2023-02-15 23:01:13,386 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(585): clone region=0190671bf7339a24b5cfb6398a4cd63d as 0190671bf7339a24b5cfb6398a4cd63d in snapshot testWithMapReduceMultiRegion 2023-02-15 23:01:13,386 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(585): clone region=7c06162354c42cfe1212016459f5e936 as 7c06162354c42cfe1212016459f5e936 in snapshot testWithMapReduceMultiRegion 2023-02-15 23:01:13,386 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(585): clone region=225454195a3f647766b594b547f3a978 as 225454195a3f647766b594b547f3a978 in snapshot testWithMapReduceMultiRegion 2023-02-15 23:01:13,386 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(585): clone region=7b66ad5c51d40cceb1755ffa12528a48 as 7b66ad5c51d40cceb1755ffa12528a48 in snapshot testWithMapReduceMultiRegion 2023-02-15 23:01:13,386 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(585): clone region=72bd5387fbbb2a758e40270a96f8650e as 72bd5387fbbb2a758e40270a96f8650e in snapshot testWithMapReduceMultiRegion 2023-02-15 23:01:13,387 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(585): clone region=9c651e4cdd5d3eb51ce657623e66c7db as 9c651e4cdd5d3eb51ce657623e66c7db in snapshot testWithMapReduceMultiRegion 2023-02-15 23:01:13,387 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(585): clone region=cc38f1967537aa31f1fc74a629715aa4 as cc38f1967537aa31f1fc74a629715aa4 in snapshot testWithMapReduceMultiRegion 2023-02-15 23:01:13,387 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(585): clone region=a1f5cc5d6ade79c61316452d39fcdd7b as a1f5cc5d6ade79c61316452d39fcdd7b in snapshot testWithMapReduceMultiRegion 2023-02-15 23:01:13,387 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(585): clone region=7bda59cbbe289d53689c842d819b62fe as 7bda59cbbe289d53689c842d819b62fe in snapshot testWithMapReduceMultiRegion 2023-02-15 23:01:13,390 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7c06162354c42cfe1212016459f5e936, NAME => 'testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30 2023-02-15 23:01:13,390 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d6f280ccad96b13bef3dc4771819bf8e, NAME => 'testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30 2023-02-15 23:01:13,391 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0190671bf7339a24b5cfb6398a4cd63d, NAME => 'testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30 2023-02-15 23:01:13,391 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 7b66ad5c51d40cceb1755ffa12528a48, NAME => 'testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30 2023-02-15 23:01:13,391 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => cc38f1967537aa31f1fc74a629715aa4, NAME => 'testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30 2023-02-15 23:01:13,392 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 9c651e4cdd5d3eb51ce657623e66c7db, NAME => 'testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30 2023-02-15 23:01:13,392 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 225454195a3f647766b594b547f3a978, NAME => 'testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30 2023-02-15 23:01:13,392 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 72bd5387fbbb2a758e40270a96f8650e, NAME => 'testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30 2023-02-15 23:01:13,417 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:13,417 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3b45952c3eea4b4a95fbdb57a8f2a5f8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,436 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 116df80b481040209a468ec293bb0062 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,441 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:13,441 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 7c06162354c42cfe1212016459f5e936, disabling compactions & flushes 2023-02-15 23:01:13,441 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:13,441 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:13,441 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. after waiting 0 ms 2023-02-15 23:01:13,441 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:13,441 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:13,441 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 7c06162354c42cfe1212016459f5e936: 2023-02-15 23:01:13,442 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => a1f5cc5d6ade79c61316452d39fcdd7b, NAME => 'testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30 2023-02-15 23:01:13,443 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:13,444 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:13,444 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 02112c01ef91447b8eb6f016f3847db5 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,444 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 85a53ec5ceb94c8489ce88dc8687eb4f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,444 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:13,445 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bc914479923e42d5b72cb3f4395911d7 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,445 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:13,446 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a9c49f4300a74a588ee9862477220246 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,451 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d6f280ccad96b13bef3dc4771819bf8e, disabling compactions & flushes 2023-02-15 23:01:13,451 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:13,451 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:13,451 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. after waiting 0 ms 2023-02-15 23:01:13,451 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:13,451 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:13,451 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d6f280ccad96b13bef3dc4771819bf8e: 2023-02-15 23:01:13,452 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7bda59cbbe289d53689c842d819b62fe, NAME => 'testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30 2023-02-15 23:01:13,456 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f897140349d243fba8812ff6aebdc384 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,456 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink af2c4783862c4ff79efe7be3228ed9ae from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,461 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 635f502302ff413fa8ea08bc7378ab60 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,462 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:13,462 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4465ed22c30846bc95e9fa4b84efb506 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,471 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9e3ba430180c4bff9e1e43b01ea1ef19 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,472 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 9c651e4cdd5d3eb51ce657623e66c7db, disabling compactions & flushes 2023-02-15 23:01:13,472 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:13,472 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:13,472 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. after waiting 0 ms 2023-02-15 23:01:13,472 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:13,472 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:13,472 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 9c651e4cdd5d3eb51ce657623e66c7db: 2023-02-15 23:01:13,472 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 72bd5387fbbb2a758e40270a96f8650e, disabling compactions & flushes 2023-02-15 23:01:13,472 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 225454195a3f647766b594b547f3a978, disabling compactions & flushes 2023-02-15 23:01:13,472 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:13,473 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:13,473 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. after waiting 0 ms 2023-02-15 23:01:13,473 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:13,472 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4015f18eded6481bbf248af727530a82 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,473 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:13,473 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 72bd5387fbbb2a758e40270a96f8650e: 2023-02-15 23:01:13,473 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:13,473 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:13,473 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. after waiting 0 ms 2023-02-15 23:01:13,473 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:13,473 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:13,473 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 225454195a3f647766b594b547f3a978: 2023-02-15 23:01:13,478 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:13,479 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:13,479 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8ae2a75d0b3b4080af7e48bd38e39251 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,479 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 7bda59cbbe289d53689c842d819b62fe, disabling compactions & flushes 2023-02-15 23:01:13,479 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:13,479 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:13,479 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. after waiting 0 ms 2023-02-15 23:01:13,479 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:13,479 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:13,479 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 7bda59cbbe289d53689c842d819b62fe: 2023-02-15 23:01:13,480 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 7b66ad5c51d40cceb1755ffa12528a48, disabling compactions & flushes 2023-02-15 23:01:13,480 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:13,480 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:13,480 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. after waiting 0 ms 2023-02-15 23:01:13,480 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:13,480 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:13,480 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 7b66ad5c51d40cceb1755ffa12528a48: 2023-02-15 23:01:13,481 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing cc38f1967537aa31f1fc74a629715aa4, disabling compactions & flushes 2023-02-15 23:01:13,481 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:13,481 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:13,481 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. after waiting 0 ms 2023-02-15 23:01:13,481 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:13,481 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:13,481 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for cc38f1967537aa31f1fc74a629715aa4: 2023-02-15 23:01:13,482 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 41750b51618b49e5a878b9cbbc527d25 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,485 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing a1f5cc5d6ade79c61316452d39fcdd7b, disabling compactions & flushes 2023-02-15 23:01:13,485 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:13,485 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:13,485 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. after waiting 0 ms 2023-02-15 23:01:13,485 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:13,485 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:13,485 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for a1f5cc5d6ade79c61316452d39fcdd7b: 2023-02-15 23:01:13,850 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:13,851 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1fa4fb006e8941d6bd9c5f8bfa9a1474 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,854 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 404d427613f84a5c9709d2f1351b13e8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 23:01:13,856 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 0190671bf7339a24b5cfb6398a4cd63d, disabling compactions & flushes 2023-02-15 23:01:13,857 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:13,857 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:13,857 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. after waiting 0 ms 2023-02-15 23:01:13,857 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:13,857 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:13,857 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 0190671bf7339a24b5cfb6398a4cd63d: 2023-02-15 23:01:13,857 INFO [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676502069906 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:13,857 DEBUG [Listener at localhost/40123] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30 2023-02-15 23:01:13,857 DEBUG [Listener at localhost/40123] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30 2023-02-15 23:01:13,858 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-data/ 2023-02-15 23:01:13,859 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |----default/ 2023-02-15 23:01:13,859 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-15 23:01:13,860 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |----------0190671bf7339a24b5cfb6398a4cd63d/ 2023-02-15 23:01:13,861 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:13,861 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:13,861 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=0190671bf7339a24b5cfb6398a4cd63d-1fa4fb006e8941d6bd9c5f8bfa9a1474 2023-02-15 23:01:13,862 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:13,862 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=0190671bf7339a24b5cfb6398a4cd63d-404d427613f84a5c9709d2f1351b13e8 2023-02-15 23:01:13,862 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |----------225454195a3f647766b594b547f3a978/ 2023-02-15 23:01:13,863 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:13,863 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:13,863 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=225454195a3f647766b594b547f3a978-02112c01ef91447b8eb6f016f3847db5 2023-02-15 23:01:13,863 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:13,864 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=225454195a3f647766b594b547f3a978-635f502302ff413fa8ea08bc7378ab60 2023-02-15 23:01:13,864 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |----------72bd5387fbbb2a758e40270a96f8650e/ 2023-02-15 23:01:13,865 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:13,865 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:13,865 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=72bd5387fbbb2a758e40270a96f8650e-a9c49f4300a74a588ee9862477220246 2023-02-15 23:01:13,865 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:13,866 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=72bd5387fbbb2a758e40270a96f8650e-f897140349d243fba8812ff6aebdc384 2023-02-15 23:01:13,866 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |----------7b66ad5c51d40cceb1755ffa12528a48/ 2023-02-15 23:01:13,866 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:13,866 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:13,867 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=7b66ad5c51d40cceb1755ffa12528a48-bc914479923e42d5b72cb3f4395911d7 2023-02-15 23:01:13,867 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:13,867 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=7b66ad5c51d40cceb1755ffa12528a48-9e3ba430180c4bff9e1e43b01ea1ef19 2023-02-15 23:01:13,867 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |----------7bda59cbbe289d53689c842d819b62fe/ 2023-02-15 23:01:13,868 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:13,868 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |----------7c06162354c42cfe1212016459f5e936/ 2023-02-15 23:01:13,868 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:13,868 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |----------9c651e4cdd5d3eb51ce657623e66c7db/ 2023-02-15 23:01:13,869 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:13,869 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:13,869 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=9c651e4cdd5d3eb51ce657623e66c7db-85a53ec5ceb94c8489ce88dc8687eb4f 2023-02-15 23:01:13,869 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:13,870 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=9c651e4cdd5d3eb51ce657623e66c7db-af2c4783862c4ff79efe7be3228ed9ae 2023-02-15 23:01:13,870 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |----------a1f5cc5d6ade79c61316452d39fcdd7b/ 2023-02-15 23:01:13,871 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:13,871 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:13,871 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=a1f5cc5d6ade79c61316452d39fcdd7b-8ae2a75d0b3b4080af7e48bd38e39251 2023-02-15 23:01:13,871 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:13,872 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=a1f5cc5d6ade79c61316452d39fcdd7b-41750b51618b49e5a878b9cbbc527d25 2023-02-15 23:01:13,872 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |----------cc38f1967537aa31f1fc74a629715aa4/ 2023-02-15 23:01:13,873 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:13,873 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:13,873 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=cc38f1967537aa31f1fc74a629715aa4-4465ed22c30846bc95e9fa4b84efb506 2023-02-15 23:01:13,873 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:13,874 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=cc38f1967537aa31f1fc74a629715aa4-4015f18eded6481bbf248af727530a82 2023-02-15 23:01:13,874 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |----------d6f280ccad96b13bef3dc4771819bf8e/ 2023-02-15 23:01:13,874 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:13,874 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:13,875 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=d6f280ccad96b13bef3dc4771819bf8e-3b45952c3eea4b4a95fbdb57a8f2a5f8 2023-02-15 23:01:13,875 DEBUG [Listener at localhost/40123] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:13,875 DEBUG [Listener at localhost/40123] util.CommonFSUtils(702): |----------------testWithMapReduce=d6f280ccad96b13bef3dc4771819bf8e-116df80b481040209a468ec293bb0062 2023-02-15 23:01:13,883 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,884 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,885 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,885 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,886 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,886 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,886 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,968 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/hadoop-8283821650998398940.jar 2023-02-15 23:01:13,969 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,969 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,970 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,970 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,971 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,971 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,972 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-15 23:01:13,973 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-15 23:01:13,973 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-15 23:01:13,974 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-15 23:01:13,974 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-15 23:01:13,975 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-15 23:01:13,976 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-15 23:01:13,976 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-15 23:01:13,977 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-15 23:01:13,977 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-15 23:01:13,983 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:13,984 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 23:01:13,984 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 23:01:13,985 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 23:01:13,985 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 23:01:14,063 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/hadoop-3801887021046736583.jar 2023-02-15 23:01:14,064 DEBUG [Listener at localhost/40123] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 23:01:14,124 WARN [Listener at localhost/40123] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-15 23:01:14,194 INFO [Listener at localhost/40123] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 23:01:14,663 WARN [Listener at localhost/40123] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/mapreduce.cluster.local.dir/1676502074522/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-15 23:01:14,663 WARN [Listener at localhost/40123] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/mapreduce.cluster.local.dir/1676502074522/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-15 23:01:14,874 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:14,875 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:14,876 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:14,880 INFO [StoreOpener-225454195a3f647766b594b547f3a978-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 225454195a3f647766b594b547f3a978 2023-02-15 23:01:14,882 DEBUG [StoreOpener-225454195a3f647766b594b547f3a978-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1 2023-02-15 23:01:14,882 INFO [StoreOpener-225454195a3f647766b594b547f3a978-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 225454195a3f647766b594b547f3a978 columnFamilyName f1 2023-02-15 23:01:14,891 DEBUG [StoreOpener-225454195a3f647766b594b547f3a978-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1/testWithMapReduce=225454195a3f647766b594b547f3a978-02112c01ef91447b8eb6f016f3847db5 2023-02-15 23:01:14,891 INFO [StoreOpener-225454195a3f647766b594b547f3a978-1] regionserver.HStore(310): Store=225454195a3f647766b594b547f3a978/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:14,892 INFO [StoreOpener-225454195a3f647766b594b547f3a978-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 225454195a3f647766b594b547f3a978 2023-02-15 23:01:14,893 DEBUG [StoreOpener-225454195a3f647766b594b547f3a978-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2 2023-02-15 23:01:14,893 INFO [StoreOpener-225454195a3f647766b594b547f3a978-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 225454195a3f647766b594b547f3a978 columnFamilyName f2 2023-02-15 23:01:14,900 DEBUG [StoreOpener-225454195a3f647766b594b547f3a978-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2/testWithMapReduce=225454195a3f647766b594b547f3a978-635f502302ff413fa8ea08bc7378ab60 2023-02-15 23:01:14,900 INFO [StoreOpener-225454195a3f647766b594b547f3a978-1] regionserver.HStore(310): Store=225454195a3f647766b594b547f3a978/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:14,900 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:14,900 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 225454195a3f647766b594b547f3a978; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70261412, jitterRate=0.04697662591934204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:14,900 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 225454195a3f647766b594b547f3a978: 2023-02-15 23:01:15,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 225454195a3f647766b594b547f3a978, disabling compactions & flushes 2023-02-15 23:01:15,071 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:15,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:15,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. after waiting 0 ms 2023-02-15 23:01:15,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:15,081 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:15,081 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 225454195a3f647766b594b547f3a978: 2023-02-15 23:01:15,095 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:15,095 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:15,101 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:15,103 INFO [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:15,104 DEBUG [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1 2023-02-15 23:01:15,104 INFO [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0190671bf7339a24b5cfb6398a4cd63d columnFamilyName f1 2023-02-15 23:01:15,113 DEBUG [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1/testWithMapReduce=0190671bf7339a24b5cfb6398a4cd63d-1fa4fb006e8941d6bd9c5f8bfa9a1474 2023-02-15 23:01:15,113 INFO [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] regionserver.HStore(310): Store=0190671bf7339a24b5cfb6398a4cd63d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,113 INFO [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:15,114 DEBUG [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2 2023-02-15 23:01:15,115 INFO [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0190671bf7339a24b5cfb6398a4cd63d columnFamilyName f2 2023-02-15 23:01:15,121 DEBUG [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2/testWithMapReduce=0190671bf7339a24b5cfb6398a4cd63d-404d427613f84a5c9709d2f1351b13e8 2023-02-15 23:01:15,121 INFO [StoreOpener-0190671bf7339a24b5cfb6398a4cd63d-1] regionserver.HStore(310): Store=0190671bf7339a24b5cfb6398a4cd63d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,122 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:15,122 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0190671bf7339a24b5cfb6398a4cd63d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59787262, jitterRate=-0.10910037159919739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:15,122 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0190671bf7339a24b5cfb6398a4cd63d: 2023-02-15 23:01:15,177 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0190671bf7339a24b5cfb6398a4cd63d, disabling compactions & flushes 2023-02-15 23:01:15,177 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:15,177 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:15,177 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. after waiting 0 ms 2023-02-15 23:01:15,177 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:15,182 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:15,182 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0190671bf7339a24b5cfb6398a4cd63d: 2023-02-15 23:01:15,188 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:15,188 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:15,189 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:15,192 INFO [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:15,193 DEBUG [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1 2023-02-15 23:01:15,194 INFO [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c651e4cdd5d3eb51ce657623e66c7db columnFamilyName f1 2023-02-15 23:01:15,203 DEBUG [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1/testWithMapReduce=9c651e4cdd5d3eb51ce657623e66c7db-85a53ec5ceb94c8489ce88dc8687eb4f 2023-02-15 23:01:15,203 INFO [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] regionserver.HStore(310): Store=9c651e4cdd5d3eb51ce657623e66c7db/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,203 INFO [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:15,205 DEBUG [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2 2023-02-15 23:01:15,205 INFO [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c651e4cdd5d3eb51ce657623e66c7db columnFamilyName f2 2023-02-15 23:01:15,213 DEBUG [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2/testWithMapReduce=9c651e4cdd5d3eb51ce657623e66c7db-af2c4783862c4ff79efe7be3228ed9ae 2023-02-15 23:01:15,213 INFO [StoreOpener-9c651e4cdd5d3eb51ce657623e66c7db-1] regionserver.HStore(310): Store=9c651e4cdd5d3eb51ce657623e66c7db/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,214 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:15,214 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9c651e4cdd5d3eb51ce657623e66c7db; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64586228, jitterRate=-0.037590205669403076}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:15,214 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9c651e4cdd5d3eb51ce657623e66c7db: 2023-02-15 23:01:15,271 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9c651e4cdd5d3eb51ce657623e66c7db, disabling compactions & flushes 2023-02-15 23:01:15,271 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:15,271 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:15,271 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. after waiting 0 ms 2023-02-15 23:01:15,271 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:15,275 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:15,275 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9c651e4cdd5d3eb51ce657623e66c7db: 2023-02-15 23:01:15,279 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:15,279 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:15,284 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:15,290 INFO [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:15,291 DEBUG [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe/f1 2023-02-15 23:01:15,292 INFO [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7bda59cbbe289d53689c842d819b62fe columnFamilyName f1 2023-02-15 23:01:15,293 INFO [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] regionserver.HStore(310): Store=7bda59cbbe289d53689c842d819b62fe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,293 INFO [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:15,295 DEBUG [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe/f2 2023-02-15 23:01:15,296 INFO [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7bda59cbbe289d53689c842d819b62fe columnFamilyName f2 2023-02-15 23:01:15,296 INFO [StoreOpener-7bda59cbbe289d53689c842d819b62fe-1] regionserver.HStore(310): Store=7bda59cbbe289d53689c842d819b62fe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,297 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:15,297 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7bda59cbbe289d53689c842d819b62fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72757455, jitterRate=0.08417056500911713}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:15,297 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7bda59cbbe289d53689c842d819b62fe: 2023-02-15 23:01:15,323 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7bda59cbbe289d53689c842d819b62fe, disabling compactions & flushes 2023-02-15 23:01:15,324 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:15,324 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:15,324 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. after waiting 0 ms 2023-02-15 23:01:15,324 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:15,325 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:15,325 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7bda59cbbe289d53689c842d819b62fe: 2023-02-15 23:01:15,331 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:15,331 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:15,332 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:15,337 INFO [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:15,338 DEBUG [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1 2023-02-15 23:01:15,338 INFO [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc38f1967537aa31f1fc74a629715aa4 columnFamilyName f1 2023-02-15 23:01:15,344 DEBUG [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1/testWithMapReduce=cc38f1967537aa31f1fc74a629715aa4-4465ed22c30846bc95e9fa4b84efb506 2023-02-15 23:01:15,345 INFO [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] regionserver.HStore(310): Store=cc38f1967537aa31f1fc74a629715aa4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,345 INFO [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:15,346 DEBUG [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2 2023-02-15 23:01:15,346 INFO [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc38f1967537aa31f1fc74a629715aa4 columnFamilyName f2 2023-02-15 23:01:15,353 DEBUG [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2/testWithMapReduce=cc38f1967537aa31f1fc74a629715aa4-4015f18eded6481bbf248af727530a82 2023-02-15 23:01:15,353 INFO [StoreOpener-cc38f1967537aa31f1fc74a629715aa4-1] regionserver.HStore(310): Store=cc38f1967537aa31f1fc74a629715aa4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,353 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:15,353 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cc38f1967537aa31f1fc74a629715aa4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60145921, jitterRate=-0.10375593602657318}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:15,353 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cc38f1967537aa31f1fc74a629715aa4: 2023-02-15 23:01:15,420 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cc38f1967537aa31f1fc74a629715aa4, disabling compactions & flushes 2023-02-15 23:01:15,420 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:15,420 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:15,420 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. after waiting 0 ms 2023-02-15 23:01:15,420 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:15,425 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:15,425 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cc38f1967537aa31f1fc74a629715aa4: 2023-02-15 23:01:15,432 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:15,432 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:15,437 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:15,439 INFO [StoreOpener-7c06162354c42cfe1212016459f5e936-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:15,441 DEBUG [StoreOpener-7c06162354c42cfe1212016459f5e936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936/f1 2023-02-15 23:01:15,441 INFO [StoreOpener-7c06162354c42cfe1212016459f5e936-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c06162354c42cfe1212016459f5e936 columnFamilyName f1 2023-02-15 23:01:15,442 INFO [StoreOpener-7c06162354c42cfe1212016459f5e936-1] regionserver.HStore(310): Store=7c06162354c42cfe1212016459f5e936/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,442 INFO [StoreOpener-7c06162354c42cfe1212016459f5e936-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:15,444 DEBUG [StoreOpener-7c06162354c42cfe1212016459f5e936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936/f2 2023-02-15 23:01:15,445 INFO [StoreOpener-7c06162354c42cfe1212016459f5e936-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c06162354c42cfe1212016459f5e936 columnFamilyName f2 2023-02-15 23:01:15,446 INFO [StoreOpener-7c06162354c42cfe1212016459f5e936-1] regionserver.HStore(310): Store=7c06162354c42cfe1212016459f5e936/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:15,446 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7c06162354c42cfe1212016459f5e936; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66997676, jitterRate=-0.0016568303108215332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:15,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7c06162354c42cfe1212016459f5e936: 2023-02-15 23:01:15,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7c06162354c42cfe1212016459f5e936, disabling compactions & flushes 2023-02-15 23:01:15,465 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:15,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:15,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. after waiting 0 ms 2023-02-15 23:01:15,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:15,465 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:15,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7c06162354c42cfe1212016459f5e936: 2023-02-15 23:01:15,470 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:15,470 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:15,471 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:15,480 INFO [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:15,482 DEBUG [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1 2023-02-15 23:01:15,482 INFO [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b66ad5c51d40cceb1755ffa12528a48 columnFamilyName f1 2023-02-15 23:01:15,488 DEBUG [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1/testWithMapReduce=7b66ad5c51d40cceb1755ffa12528a48-bc914479923e42d5b72cb3f4395911d7 2023-02-15 23:01:15,489 INFO [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] regionserver.HStore(310): Store=7b66ad5c51d40cceb1755ffa12528a48/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,489 INFO [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:15,490 DEBUG [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2 2023-02-15 23:01:15,490 INFO [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b66ad5c51d40cceb1755ffa12528a48 columnFamilyName f2 2023-02-15 23:01:15,497 DEBUG [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2/testWithMapReduce=7b66ad5c51d40cceb1755ffa12528a48-9e3ba430180c4bff9e1e43b01ea1ef19 2023-02-15 23:01:15,497 INFO [StoreOpener-7b66ad5c51d40cceb1755ffa12528a48-1] regionserver.HStore(310): Store=7b66ad5c51d40cceb1755ffa12528a48/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,497 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:15,497 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7b66ad5c51d40cceb1755ffa12528a48; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70713811, jitterRate=0.05371789634227753}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:15,498 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7b66ad5c51d40cceb1755ffa12528a48: 2023-02-15 23:01:15,533 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7b66ad5c51d40cceb1755ffa12528a48, disabling compactions & flushes 2023-02-15 23:01:15,533 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:15,533 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:15,533 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. after waiting 0 ms 2023-02-15 23:01:15,533 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:15,536 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:15,537 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7b66ad5c51d40cceb1755ffa12528a48: 2023-02-15 23:01:15,544 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:15,544 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:15,546 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:15,548 INFO [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:15,550 DEBUG [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1 2023-02-15 23:01:15,550 INFO [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1f5cc5d6ade79c61316452d39fcdd7b columnFamilyName f1 2023-02-15 23:01:15,556 DEBUG [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1/testWithMapReduce=a1f5cc5d6ade79c61316452d39fcdd7b-8ae2a75d0b3b4080af7e48bd38e39251 2023-02-15 23:01:15,556 INFO [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] regionserver.HStore(310): Store=a1f5cc5d6ade79c61316452d39fcdd7b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,556 INFO [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:15,557 DEBUG [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2 2023-02-15 23:01:15,557 INFO [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1f5cc5d6ade79c61316452d39fcdd7b columnFamilyName f2 2023-02-15 23:01:15,563 DEBUG [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2/testWithMapReduce=a1f5cc5d6ade79c61316452d39fcdd7b-41750b51618b49e5a878b9cbbc527d25 2023-02-15 23:01:15,563 INFO [StoreOpener-a1f5cc5d6ade79c61316452d39fcdd7b-1] regionserver.HStore(310): Store=a1f5cc5d6ade79c61316452d39fcdd7b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,563 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:15,563 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a1f5cc5d6ade79c61316452d39fcdd7b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58909760, jitterRate=-0.1221761703491211}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:15,563 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a1f5cc5d6ade79c61316452d39fcdd7b: 2023-02-15 23:01:15,592 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a1f5cc5d6ade79c61316452d39fcdd7b, disabling compactions & flushes 2023-02-15 23:01:15,592 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:15,592 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:15,592 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. after waiting 0 ms 2023-02-15 23:01:15,592 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:15,596 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:15,596 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a1f5cc5d6ade79c61316452d39fcdd7b: 2023-02-15 23:01:15,599 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:15,599 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:15,600 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:15,602 INFO [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:15,603 DEBUG [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1 2023-02-15 23:01:15,604 INFO [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72bd5387fbbb2a758e40270a96f8650e columnFamilyName f1 2023-02-15 23:01:15,612 DEBUG [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1/testWithMapReduce=72bd5387fbbb2a758e40270a96f8650e-a9c49f4300a74a588ee9862477220246 2023-02-15 23:01:15,612 INFO [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] regionserver.HStore(310): Store=72bd5387fbbb2a758e40270a96f8650e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,612 INFO [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:15,613 DEBUG [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2 2023-02-15 23:01:15,614 INFO [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72bd5387fbbb2a758e40270a96f8650e columnFamilyName f2 2023-02-15 23:01:15,654 DEBUG [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2/testWithMapReduce=72bd5387fbbb2a758e40270a96f8650e-f897140349d243fba8812ff6aebdc384 2023-02-15 23:01:15,654 INFO [StoreOpener-72bd5387fbbb2a758e40270a96f8650e-1] regionserver.HStore(310): Store=72bd5387fbbb2a758e40270a96f8650e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,654 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:15,655 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 72bd5387fbbb2a758e40270a96f8650e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73065000, jitterRate=0.088753342628479}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:15,655 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 72bd5387fbbb2a758e40270a96f8650e: 2023-02-15 23:01:15,716 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 72bd5387fbbb2a758e40270a96f8650e, disabling compactions & flushes 2023-02-15 23:01:15,716 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:15,716 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:15,716 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. after waiting 0 ms 2023-02-15 23:01:15,716 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:15,749 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:15,749 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 72bd5387fbbb2a758e40270a96f8650e: 2023-02-15 23:01:15,754 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:15,754 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:15,755 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:15,760 INFO [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:15,761 DEBUG [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1 2023-02-15 23:01:15,762 INFO [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6f280ccad96b13bef3dc4771819bf8e columnFamilyName f1 2023-02-15 23:01:15,768 DEBUG [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1/testWithMapReduce=d6f280ccad96b13bef3dc4771819bf8e-3b45952c3eea4b4a95fbdb57a8f2a5f8 2023-02-15 23:01:15,768 INFO [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] regionserver.HStore(310): Store=d6f280ccad96b13bef3dc4771819bf8e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,769 INFO [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:15,769 DEBUG [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2 2023-02-15 23:01:15,770 INFO [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6f280ccad96b13bef3dc4771819bf8e columnFamilyName f2 2023-02-15 23:01:15,775 DEBUG [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] regionserver.HStore(539): loaded hdfs://localhost:41805/user/jenkins/test-data/8e5634ce-ced2-d704-1b46-ea6e64aa5945/testWithMapReduceMultiRegion/2bb512c2-adab-46ef-a08b-d250b506ab30/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2/testWithMapReduce=d6f280ccad96b13bef3dc4771819bf8e-116df80b481040209a468ec293bb0062 2023-02-15 23:01:15,775 INFO [StoreOpener-d6f280ccad96b13bef3dc4771819bf8e-1] regionserver.HStore(310): Store=d6f280ccad96b13bef3dc4771819bf8e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:15,775 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:15,775 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d6f280ccad96b13bef3dc4771819bf8e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72931051, jitterRate=0.0867573469877243}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:15,776 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d6f280ccad96b13bef3dc4771819bf8e: 2023-02-15 23:01:15,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d6f280ccad96b13bef3dc4771819bf8e, disabling compactions & flushes 2023-02-15 23:01:15,817 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:15,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:15,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. after waiting 0 ms 2023-02-15 23:01:15,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:15,823 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:15,823 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d6f280ccad96b13bef3dc4771819bf8e: 2023-02-15 23:01:16,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-15 23:01:16,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-15 23:01:16,793 INFO [Listener at localhost/40123] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 23:01:16,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 23:01:16,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-15 23:01:16,804 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502076803"}]},"ts":"1676502076803"} 2023-02-15 23:01:16,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 23:01:16,806 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-15 23:01:16,808 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-15 23:01:16,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7c06162354c42cfe1212016459f5e936, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cc38f1967537aa31f1fc74a629715aa4, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=225454195a3f647766b594b547f3a978, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d6f280ccad96b13bef3dc4771819bf8e, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0190671bf7339a24b5cfb6398a4cd63d, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=72bd5387fbbb2a758e40270a96f8650e, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9c651e4cdd5d3eb51ce657623e66c7db, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a1f5cc5d6ade79c61316452d39fcdd7b, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7b66ad5c51d40cceb1755ffa12528a48, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7bda59cbbe289d53689c842d819b62fe, UNASSIGN}] 2023-02-15 23:01:16,813 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9c651e4cdd5d3eb51ce657623e66c7db, UNASSIGN 2023-02-15 23:01:16,813 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7b66ad5c51d40cceb1755ffa12528a48, UNASSIGN 2023-02-15 23:01:16,814 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7bda59cbbe289d53689c842d819b62fe, UNASSIGN 2023-02-15 23:01:16,814 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a1f5cc5d6ade79c61316452d39fcdd7b, UNASSIGN 2023-02-15 23:01:16,814 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=72bd5387fbbb2a758e40270a96f8650e, UNASSIGN 2023-02-15 23:01:16,814 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9c651e4cdd5d3eb51ce657623e66c7db, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:16,815 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=a1f5cc5d6ade79c61316452d39fcdd7b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:16,814 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7b66ad5c51d40cceb1755ffa12528a48, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:16,814 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7bda59cbbe289d53689c842d819b62fe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:16,815 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502076814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502076814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502076814"}]},"ts":"1676502076814"} 2023-02-15 23:01:16,815 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502076814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502076814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502076814"}]},"ts":"1676502076814"} 2023-02-15 23:01:16,815 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502076814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502076814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502076814"}]},"ts":"1676502076814"} 2023-02-15 23:01:16,815 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502076814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502076814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502076814"}]},"ts":"1676502076814"} 2023-02-15 23:01:16,816 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=72bd5387fbbb2a758e40270a96f8650e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:16,816 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502076815"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502076815"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502076815"}]},"ts":"1676502076815"} 2023-02-15 23:01:16,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE; CloseRegionProcedure 7bda59cbbe289d53689c842d819b62fe, server=jenkins-hbase4.apache.org,33507,1676502063190}] 2023-02-15 23:01:16,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=40, state=RUNNABLE; CloseRegionProcedure 9c651e4cdd5d3eb51ce657623e66c7db, server=jenkins-hbase4.apache.org,43695,1676502063240}] 2023-02-15 23:01:16,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=41, state=RUNNABLE; CloseRegionProcedure a1f5cc5d6ade79c61316452d39fcdd7b, server=jenkins-hbase4.apache.org,33507,1676502063190}] 2023-02-15 23:01:16,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=42, state=RUNNABLE; CloseRegionProcedure 7b66ad5c51d40cceb1755ffa12528a48, server=jenkins-hbase4.apache.org,43695,1676502063240}] 2023-02-15 23:01:16,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=39, state=RUNNABLE; CloseRegionProcedure 72bd5387fbbb2a758e40270a96f8650e, server=jenkins-hbase4.apache.org,43695,1676502063240}] 2023-02-15 23:01:16,826 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0190671bf7339a24b5cfb6398a4cd63d, UNASSIGN 2023-02-15 23:01:16,826 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d6f280ccad96b13bef3dc4771819bf8e, UNASSIGN 2023-02-15 23:01:16,826 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=225454195a3f647766b594b547f3a978, UNASSIGN 2023-02-15 23:01:16,827 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cc38f1967537aa31f1fc74a629715aa4, UNASSIGN 2023-02-15 23:01:16,827 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7c06162354c42cfe1212016459f5e936, UNASSIGN 2023-02-15 23:01:16,827 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0190671bf7339a24b5cfb6398a4cd63d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:16,827 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502076827"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502076827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502076827"}]},"ts":"1676502076827"} 2023-02-15 23:01:16,828 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=225454195a3f647766b594b547f3a978, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:16,828 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=7c06162354c42cfe1212016459f5e936, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:16,828 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676502067198.225454195a3f647766b594b547f3a978.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502076828"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502076828"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502076828"}]},"ts":"1676502076828"} 2023-02-15 23:01:16,828 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502076828"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502076828"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502076828"}]},"ts":"1676502076828"} 2023-02-15 23:01:16,828 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=cc38f1967537aa31f1fc74a629715aa4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:16,828 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=d6f280ccad96b13bef3dc4771819bf8e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:16,828 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502076828"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502076828"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502076828"}]},"ts":"1676502076828"} 2023-02-15 23:01:16,828 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502076828"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502076828"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502076828"}]},"ts":"1676502076828"} 2023-02-15 23:01:16,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure 0190671bf7339a24b5cfb6398a4cd63d, server=jenkins-hbase4.apache.org,33507,1676502063190}] 2023-02-15 23:01:16,830 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=36, state=RUNNABLE; CloseRegionProcedure 225454195a3f647766b594b547f3a978, server=jenkins-hbase4.apache.org,33507,1676502063190}] 2023-02-15 23:01:16,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=34, state=RUNNABLE; CloseRegionProcedure 7c06162354c42cfe1212016459f5e936, server=jenkins-hbase4.apache.org,43695,1676502063240}] 2023-02-15 23:01:16,833 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure cc38f1967537aa31f1fc74a629715aa4, server=jenkins-hbase4.apache.org,33507,1676502063190}] 2023-02-15 23:01:16,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=37, state=RUNNABLE; CloseRegionProcedure d6f280ccad96b13bef3dc4771819bf8e, server=jenkins-hbase4.apache.org,43695,1676502063240}] 2023-02-15 23:01:16,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 23:01:16,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:16,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:16,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0190671bf7339a24b5cfb6398a4cd63d, disabling compactions & flushes 2023-02-15 23:01:16,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7b66ad5c51d40cceb1755ffa12528a48, disabling compactions & flushes 2023-02-15 23:01:16,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:16,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:16,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:16,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:16,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. after waiting 0 ms 2023-02-15 23:01:16,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:16,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. after waiting 0 ms 2023-02-15 23:01:16,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:16,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:16,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:16,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48. 2023-02-15 23:01:16,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d. 2023-02-15 23:01:16,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7b66ad5c51d40cceb1755ffa12528a48: 2023-02-15 23:01:16,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0190671bf7339a24b5cfb6398a4cd63d: 2023-02-15 23:01:16,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:16,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:16,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 72bd5387fbbb2a758e40270a96f8650e, disabling compactions & flushes 2023-02-15 23:01:16,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:16,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:16,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. after waiting 0 ms 2023-02-15 23:01:16,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:16,994 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7b66ad5c51d40cceb1755ffa12528a48, regionState=CLOSED 2023-02-15 23:01:16,995 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502076994"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502076994"}]},"ts":"1676502076994"} 2023-02-15 23:01:16,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:16,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:16,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a1f5cc5d6ade79c61316452d39fcdd7b, disabling compactions & flushes 2023-02-15 23:01:16,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:16,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:16,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. after waiting 0 ms 2023-02-15 23:01:16,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:16,996 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0190671bf7339a24b5cfb6398a4cd63d, regionState=CLOSED 2023-02-15 23:01:16,996 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502076996"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502076996"}]},"ts":"1676502076996"} 2023-02-15 23:01:17,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=42 2023-02-15 23:01:17,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=42, state=SUCCESS; CloseRegionProcedure 7b66ad5c51d40cceb1755ffa12528a48, server=jenkins-hbase4.apache.org,43695,1676502063240 in 179 msec 2023-02-15 23:01:17,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-15 23:01:17,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure 0190671bf7339a24b5cfb6398a4cd63d, server=jenkins-hbase4.apache.org,33507,1676502063190 in 170 msec 2023-02-15 23:01:17,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:17,009 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7b66ad5c51d40cceb1755ffa12528a48, UNASSIGN in 195 msec 2023-02-15 23:01:17,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e. 2023-02-15 23:01:17,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0190671bf7339a24b5cfb6398a4cd63d, UNASSIGN in 199 msec 2023-02-15 23:01:17,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 72bd5387fbbb2a758e40270a96f8650e: 2023-02-15 23:01:17,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:17,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b. 2023-02-15 23:01:17,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a1f5cc5d6ade79c61316452d39fcdd7b: 2023-02-15 23:01:17,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:17,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:17,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9c651e4cdd5d3eb51ce657623e66c7db, disabling compactions & flushes 2023-02-15 23:01:17,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:17,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:17,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. after waiting 0 ms 2023-02-15 23:01:17,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:17,015 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=72bd5387fbbb2a758e40270a96f8650e, regionState=CLOSED 2023-02-15 23:01:17,016 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502077015"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502077015"}]},"ts":"1676502077015"} 2023-02-15 23:01:17,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:17,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 225454195a3f647766b594b547f3a978 2023-02-15 23:01:17,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 225454195a3f647766b594b547f3a978, disabling compactions & flushes 2023-02-15 23:01:17,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:17,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:17,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. after waiting 0 ms 2023-02-15 23:01:17,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:17,017 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=a1f5cc5d6ade79c61316452d39fcdd7b, regionState=CLOSED 2023-02-15 23:01:17,017 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502077017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502077017"}]},"ts":"1676502077017"} 2023-02-15 23:01:17,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=39 2023-02-15 23:01:17,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=39, state=SUCCESS; CloseRegionProcedure 72bd5387fbbb2a758e40270a96f8650e, server=jenkins-hbase4.apache.org,43695,1676502063240 in 198 msec 2023-02-15 23:01:17,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=41 2023-02-15 23:01:17,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=41, state=SUCCESS; CloseRegionProcedure a1f5cc5d6ade79c61316452d39fcdd7b, server=jenkins-hbase4.apache.org,33507,1676502063190 in 200 msec 2023-02-15 23:01:17,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=72bd5387fbbb2a758e40270a96f8650e, UNASSIGN in 211 msec 2023-02-15 23:01:17,025 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a1f5cc5d6ade79c61316452d39fcdd7b, UNASSIGN in 214 msec 2023-02-15 23:01:17,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:17,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:17,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db. 2023-02-15 23:01:17,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9c651e4cdd5d3eb51ce657623e66c7db: 2023-02-15 23:01:17,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978. 2023-02-15 23:01:17,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 225454195a3f647766b594b547f3a978: 2023-02-15 23:01:17,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:17,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:17,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d6f280ccad96b13bef3dc4771819bf8e, disabling compactions & flushes 2023-02-15 23:01:17,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:17,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:17,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. after waiting 0 ms 2023-02-15 23:01:17,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:17,044 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9c651e4cdd5d3eb51ce657623e66c7db, regionState=CLOSED 2023-02-15 23:01:17,044 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502077044"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502077044"}]},"ts":"1676502077044"} 2023-02-15 23:01:17,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 225454195a3f647766b594b547f3a978 2023-02-15 23:01:17,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:17,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7bda59cbbe289d53689c842d819b62fe, disabling compactions & flushes 2023-02-15 23:01:17,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:17,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:17,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. after waiting 0 ms 2023-02-15 23:01:17,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:17,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:17,052 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=225454195a3f647766b594b547f3a978, regionState=CLOSED 2023-02-15 23:01:17,053 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676502067198.225454195a3f647766b594b547f3a978.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502077052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502077052"}]},"ts":"1676502077052"} 2023-02-15 23:01:17,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e. 2023-02-15 23:01:17,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d6f280ccad96b13bef3dc4771819bf8e: 2023-02-15 23:01:17,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:17,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:17,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7c06162354c42cfe1212016459f5e936, disabling compactions & flushes 2023-02-15 23:01:17,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:17,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:17,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. after waiting 0 ms 2023-02-15 23:01:17,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:17,057 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=d6f280ccad96b13bef3dc4771819bf8e, regionState=CLOSED 2023-02-15 23:01:17,057 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502077057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502077057"}]},"ts":"1676502077057"} 2023-02-15 23:01:17,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=40 2023-02-15 23:01:17,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=40, state=SUCCESS; CloseRegionProcedure 9c651e4cdd5d3eb51ce657623e66c7db, server=jenkins-hbase4.apache.org,43695,1676502063240 in 229 msec 2023-02-15 23:01:17,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 23:01:17,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe. 2023-02-15 23:01:17,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7bda59cbbe289d53689c842d819b62fe: 2023-02-15 23:01:17,061 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9c651e4cdd5d3eb51ce657623e66c7db, UNASSIGN in 249 msec 2023-02-15 23:01:17,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=36 2023-02-15 23:01:17,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=36, state=SUCCESS; CloseRegionProcedure 225454195a3f647766b594b547f3a978, server=jenkins-hbase4.apache.org,33507,1676502063190 in 225 msec 2023-02-15 23:01:17,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:17,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:17,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cc38f1967537aa31f1fc74a629715aa4, disabling compactions & flushes 2023-02-15 23:01:17,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:17,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 23:01:17,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=225454195a3f647766b594b547f3a978, UNASSIGN in 253 msec 2023-02-15 23:01:17,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:17,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. after waiting 0 ms 2023-02-15 23:01:17,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:17,065 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=37 2023-02-15 23:01:17,065 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7bda59cbbe289d53689c842d819b62fe, regionState=CLOSED 2023-02-15 23:01:17,065 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502077065"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502077065"}]},"ts":"1676502077065"} 2023-02-15 23:01:17,065 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=37, state=SUCCESS; CloseRegionProcedure d6f280ccad96b13bef3dc4771819bf8e, server=jenkins-hbase4.apache.org,43695,1676502063240 in 225 msec 2023-02-15 23:01:17,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d6f280ccad96b13bef3dc4771819bf8e, UNASSIGN in 256 msec 2023-02-15 23:01:17,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-15 23:01:17,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; CloseRegionProcedure 7bda59cbbe289d53689c842d819b62fe, server=jenkins-hbase4.apache.org,33507,1676502063190 in 250 msec 2023-02-15 23:01:17,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7bda59cbbe289d53689c842d819b62fe, UNASSIGN in 258 msec 2023-02-15 23:01:17,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936. 2023-02-15 23:01:17,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7c06162354c42cfe1212016459f5e936: 2023-02-15 23:01:17,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:17,075 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=7c06162354c42cfe1212016459f5e936, regionState=CLOSED 2023-02-15 23:01:17,075 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502077075"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502077075"}]},"ts":"1676502077075"} 2023-02-15 23:01:17,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:17,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4. 2023-02-15 23:01:17,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cc38f1967537aa31f1fc74a629715aa4: 2023-02-15 23:01:17,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=34 2023-02-15 23:01:17,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=34, state=SUCCESS; CloseRegionProcedure 7c06162354c42cfe1212016459f5e936, server=jenkins-hbase4.apache.org,43695,1676502063240 in 245 msec 2023-02-15 23:01:17,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:17,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7c06162354c42cfe1212016459f5e936, UNASSIGN in 272 msec 2023-02-15 23:01:17,083 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=cc38f1967537aa31f1fc74a629715aa4, regionState=CLOSED 2023-02-15 23:01:17,083 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502077083"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502077083"}]},"ts":"1676502077083"} 2023-02-15 23:01:17,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-15 23:01:17,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure cc38f1967537aa31f1fc74a629715aa4, server=jenkins-hbase4.apache.org,33507,1676502063190 in 252 msec 2023-02-15 23:01:17,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=33 2023-02-15 23:01:17,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cc38f1967537aa31f1fc74a629715aa4, UNASSIGN in 279 msec 2023-02-15 23:01:17,091 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502077091"}]},"ts":"1676502077091"} 2023-02-15 23:01:17,093 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-15 23:01:17,095 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-15 23:01:17,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 300 msec 2023-02-15 23:01:17,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 23:01:17,109 INFO [Listener at localhost/40123] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-15 23:01:17,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-15 23:01:17,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-15 23:01:17,122 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 23:01:17,124 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 23:01:17,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 23:01:17,141 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:17,142 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:17,142 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978 2023-02-15 23:01:17,142 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:17,142 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:17,142 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:17,142 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:17,142 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:17,150 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/recovered.edits] 2023-02-15 23:01:17,151 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/recovered.edits] 2023-02-15 23:01:17,151 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936/f1, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936/f2, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936/recovered.edits] 2023-02-15 23:01:17,151 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/recovered.edits] 2023-02-15 23:01:17,151 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/recovered.edits] 2023-02-15 23:01:17,151 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/recovered.edits] 2023-02-15 23:01:17,153 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/recovered.edits] 2023-02-15 23:01:17,153 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/recovered.edits] 2023-02-15 23:01:17,165 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1/2ae95eaceeba40c6a0f6915d44d52112 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1/2ae95eaceeba40c6a0f6915d44d52112 2023-02-15 23:01:17,166 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1/8ae2a75d0b3b4080af7e48bd38e39251 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1/8ae2a75d0b3b4080af7e48bd38e39251 2023-02-15 23:01:17,169 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1/b0ac0e8ee7ff4f36bc555b638b1e2719 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f1/b0ac0e8ee7ff4f36bc555b638b1e2719 2023-02-15 23:01:17,170 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1/a9c49f4300a74a588ee9862477220246 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f1/a9c49f4300a74a588ee9862477220246 2023-02-15 23:01:17,171 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1/02112c01ef91447b8eb6f016f3847db5 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1/02112c01ef91447b8eb6f016f3847db5 2023-02-15 23:01:17,171 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1/04cab5f109734c35a72b09a6df76ebae to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1/04cab5f109734c35a72b09a6df76ebae 2023-02-15 23:01:17,172 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1/55a4ca86039244b5ac6339e275c8a396 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1/55a4ca86039244b5ac6339e275c8a396 2023-02-15 23:01:17,172 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1/1fa4fb006e8941d6bd9c5f8bfa9a1474 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1/1fa4fb006e8941d6bd9c5f8bfa9a1474 2023-02-15 23:01:17,173 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1/3b45952c3eea4b4a95fbdb57a8f2a5f8 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1/3b45952c3eea4b4a95fbdb57a8f2a5f8 2023-02-15 23:01:17,175 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1/ba09f79cf52948f3885ab7e9c8ab7eb8 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f1/ba09f79cf52948f3885ab7e9c8ab7eb8 2023-02-15 23:01:17,176 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1/4465ed22c30846bc95e9fa4b84efb506 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f1/4465ed22c30846bc95e9fa4b84efb506 2023-02-15 23:01:17,176 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1/85a53ec5ceb94c8489ce88dc8687eb4f to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f1/85a53ec5ceb94c8489ce88dc8687eb4f 2023-02-15 23:01:17,176 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936/recovered.edits/6.seqid to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936/recovered.edits/6.seqid 2023-02-15 23:01:17,177 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1/5e81e10c20954293a732838867597b56 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f1/5e81e10c20954293a732838867597b56 2023-02-15 23:01:17,177 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1/c901e0ad9af4405a9bfde06a8f890e7c to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f1/c901e0ad9af4405a9bfde06a8f890e7c 2023-02-15 23:01:17,178 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7c06162354c42cfe1212016459f5e936 2023-02-15 23:01:17,178 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:17,180 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2/41750b51618b49e5a878b9cbbc527d25 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2/41750b51618b49e5a878b9cbbc527d25 2023-02-15 23:01:17,182 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2/53dc0e8aa1924718850e90b7adc0637a to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2/53dc0e8aa1924718850e90b7adc0637a 2023-02-15 23:01:17,187 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/recovered.edits] 2023-02-15 23:01:17,187 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2/4015f18eded6481bbf248af727530a82 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2/4015f18eded6481bbf248af727530a82 2023-02-15 23:01:17,187 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2/8c0b5ab95cbb48558beaebb423a36ca5 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/f2/8c0b5ab95cbb48558beaebb423a36ca5 2023-02-15 23:01:17,188 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2/f897140349d243fba8812ff6aebdc384 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/f2/f897140349d243fba8812ff6aebdc384 2023-02-15 23:01:17,189 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2/3ae3b1dcd9354bd6a6e5b12ba63ca1b1 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2/3ae3b1dcd9354bd6a6e5b12ba63ca1b1 2023-02-15 23:01:17,189 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2/2a47e913b2db434b9dfca22892ea5d2c to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2/2a47e913b2db434b9dfca22892ea5d2c 2023-02-15 23:01:17,189 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2/404d427613f84a5c9709d2f1351b13e8 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2/404d427613f84a5c9709d2f1351b13e8 2023-02-15 23:01:17,190 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2/116df80b481040209a468ec293bb0062 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2/116df80b481040209a468ec293bb0062 2023-02-15 23:01:17,192 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2/dceaf231bb4745fbbb11762addabdb09 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/f2/dceaf231bb4745fbbb11762addabdb09 2023-02-15 23:01:17,193 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2/635f502302ff413fa8ea08bc7378ab60 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/f2/635f502302ff413fa8ea08bc7378ab60 2023-02-15 23:01:17,193 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2/838354c97f5c42a8aef40cfe7b093743 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/f2/838354c97f5c42a8aef40cfe7b093743 2023-02-15 23:01:17,195 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2/eb8cd72469984e7491a6e05e4a2a019a to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/f2/eb8cd72469984e7491a6e05e4a2a019a 2023-02-15 23:01:17,198 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2/af2c4783862c4ff79efe7be3228ed9ae to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/f2/af2c4783862c4ff79efe7be3228ed9ae 2023-02-15 23:01:17,199 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/recovered.edits/12.seqid to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b/recovered.edits/12.seqid 2023-02-15 23:01:17,200 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/recovered.edits/12.seqid to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e/recovered.edits/12.seqid 2023-02-15 23:01:17,204 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/a1f5cc5d6ade79c61316452d39fcdd7b 2023-02-15 23:01:17,204 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:17,204 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/72bd5387fbbb2a758e40270a96f8650e 2023-02-15 23:01:17,210 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/recovered.edits/12.seqid to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d/recovered.edits/12.seqid 2023-02-15 23:01:17,211 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1/bc914479923e42d5b72cb3f4395911d7 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1/bc914479923e42d5b72cb3f4395911d7 2023-02-15 23:01:17,211 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/recovered.edits/12.seqid to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978/recovered.edits/12.seqid 2023-02-15 23:01:17,211 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/recovered.edits/12.seqid to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4/recovered.edits/12.seqid 2023-02-15 23:01:17,212 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/recovered.edits/12.seqid to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e/recovered.edits/12.seqid 2023-02-15 23:01:17,212 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/0190671bf7339a24b5cfb6398a4cd63d 2023-02-15 23:01:17,213 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/225454195a3f647766b594b547f3a978 2023-02-15 23:01:17,213 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/cc38f1967537aa31f1fc74a629715aa4 2023-02-15 23:01:17,213 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/d6f280ccad96b13bef3dc4771819bf8e 2023-02-15 23:01:17,214 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe/f1, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe/f2, FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe/recovered.edits] 2023-02-15 23:01:17,215 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1/fd3361d75fd34cd48ba322ac2a3492a8 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f1/fd3361d75fd34cd48ba322ac2a3492a8 2023-02-15 23:01:17,215 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/recovered.edits/12.seqid to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db/recovered.edits/12.seqid 2023-02-15 23:01:17,216 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/9c651e4cdd5d3eb51ce657623e66c7db 2023-02-15 23:01:17,221 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2/2d672bc6a82742caa20ce60dbb33d641 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2/2d672bc6a82742caa20ce60dbb33d641 2023-02-15 23:01:17,223 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe/recovered.edits/6.seqid to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe/recovered.edits/6.seqid 2023-02-15 23:01:17,224 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2/9e3ba430180c4bff9e1e43b01ea1ef19 to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/f2/9e3ba430180c4bff9e1e43b01ea1ef19 2023-02-15 23:01:17,224 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7bda59cbbe289d53689c842d819b62fe 2023-02-15 23:01:17,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 23:01:17,229 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/recovered.edits/12.seqid to hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/archive/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48/recovered.edits/12.seqid 2023-02-15 23:01:17,229 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/.tmp/data/default/testWithMapReduce/7b66ad5c51d40cceb1755ffa12528a48 2023-02-15 23:01:17,229 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 23:01:17,233 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 23:01:17,268 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-15 23:01:17,272 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-15 23:01:17,274 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 23:01:17,274 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-15 23:01:17,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502077275"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:17,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502077275"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:17,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676502067198.225454195a3f647766b594b547f3a978.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502077275"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:17,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502077275"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:17,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502077275"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:17,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502077275"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:17,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502077275"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:17,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502077275"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:17,276 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502077275"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:17,276 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502077275"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:17,279 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-15 23:01:17,279 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7c06162354c42cfe1212016459f5e936, NAME => 'testWithMapReduce,,1676502067198.7c06162354c42cfe1212016459f5e936.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => cc38f1967537aa31f1fc74a629715aa4, NAME => 'testWithMapReduce,aaa,1676502067198.cc38f1967537aa31f1fc74a629715aa4.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 225454195a3f647766b594b547f3a978, NAME => 'testWithMapReduce,d\x84\x84,1676502067198.225454195a3f647766b594b547f3a978.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => d6f280ccad96b13bef3dc4771819bf8e, NAME => 'testWithMapReduce,g\xA7\xA7,1676502067198.d6f280ccad96b13bef3dc4771819bf8e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 0190671bf7339a24b5cfb6398a4cd63d, NAME => 'testWithMapReduce,j\xCA\xCA,1676502067198.0190671bf7339a24b5cfb6398a4cd63d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 72bd5387fbbb2a758e40270a96f8650e, NAME => 'testWithMapReduce,m\xED\xED,1676502067198.72bd5387fbbb2a758e40270a96f8650e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 9c651e4cdd5d3eb51ce657623e66c7db, NAME => 'testWithMapReduce,q\x11\x10,1676502067198.9c651e4cdd5d3eb51ce657623e66c7db.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => a1f5cc5d6ade79c61316452d39fcdd7b, NAME => 'testWithMapReduce,t43,1676502067198.a1f5cc5d6ade79c61316452d39fcdd7b.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 7b66ad5c51d40cceb1755ffa12528a48, NAME => 'testWithMapReduce,wWV,1676502067198.7b66ad5c51d40cceb1755ffa12528a48.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 7bda59cbbe289d53689c842d819b62fe, NAME => 'testWithMapReduce,zz{,1676502067198.7bda59cbbe289d53689c842d819b62fe.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-15 23:01:17,279 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-15 23:01:17,279 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676502077279"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:17,282 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-15 23:01:17,284 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 23:01:17,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 169 msec 2023-02-15 23:01:17,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44547] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 23:01:17,430 INFO [Listener at localhost/40123] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-15 23:01:17,431 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 23:01:17,431 INFO [Listener at localhost/40123] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 23:01:17,431 DEBUG [Listener at localhost/40123] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x659a4d79 to 127.0.0.1:64794 2023-02-15 23:01:17,431 DEBUG [Listener at localhost/40123] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:17,431 DEBUG [Listener at localhost/40123] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 23:01:17,431 DEBUG [Listener at localhost/40123] util.JVMClusterUtil(257): Found active master hash=297978354, stopped=false 2023-02-15 23:01:17,431 INFO [Listener at localhost/40123] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44547,1676502061974 2023-02-15 23:01:17,439 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:17,439 INFO [Listener at localhost/40123] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 23:01:17,439 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:17,439 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:17,439 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:17,441 DEBUG [Listener at localhost/40123] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ca438cc to 127.0.0.1:64794 2023-02-15 23:01:17,441 DEBUG [Listener at localhost/40123] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:17,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:17,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:17,441 INFO [Listener at localhost/40123] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33507,1676502063190' ***** 2023-02-15 23:01:17,441 INFO [Listener at localhost/40123] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:17,441 INFO [Listener at localhost/40123] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43695,1676502063240' ***** 2023-02-15 23:01:17,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:17,442 INFO [RS:0;jenkins-hbase4:33507] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:17,441 INFO [Listener at localhost/40123] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:17,442 INFO [RS:0;jenkins-hbase4:33507] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:17,442 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:17,442 INFO [RS:0;jenkins-hbase4:33507] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:17,442 INFO [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(3304): Received CLOSE for a3745ab366923d5a288dcc5afe26f918 2023-02-15 23:01:17,443 INFO [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:17,443 DEBUG [RS:0;jenkins-hbase4:33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fe8dcad to 127.0.0.1:64794 2023-02-15 23:01:17,443 DEBUG [RS:0;jenkins-hbase4:33507] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:17,443 INFO [RS:0;jenkins-hbase4:33507] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:17,443 INFO [RS:0;jenkins-hbase4:33507] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:17,443 INFO [RS:0;jenkins-hbase4:33507] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:17,443 INFO [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 23:01:17,442 INFO [RS:1;jenkins-hbase4:43695] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:17,444 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:17,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a3745ab366923d5a288dcc5afe26f918, disabling compactions & flushes 2023-02-15 23:01:17,445 INFO [RS:1;jenkins-hbase4:43695] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:17,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. 2023-02-15 23:01:17,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. 2023-02-15 23:01:17,446 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:17,445 INFO [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-15 23:01:17,446 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:17,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. after waiting 0 ms 2023-02-15 23:01:17,445 INFO [RS:1;jenkins-hbase4:43695] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:17,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. 2023-02-15 23:01:17,446 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:17,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing a3745ab366923d5a288dcc5afe26f918 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 23:01:17,446 DEBUG [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, a3745ab366923d5a288dcc5afe26f918=hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918.} 2023-02-15 23:01:17,446 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:17,447 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:17,447 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-15 23:01:17,448 DEBUG [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1505): Waiting on 1588230740, a3745ab366923d5a288dcc5afe26f918 2023-02-15 23:01:17,446 INFO [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:17,449 DEBUG [RS:1;jenkins-hbase4:43695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a844062 to 127.0.0.1:64794 2023-02-15 23:01:17,449 DEBUG [RS:1;jenkins-hbase4:43695] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:17,449 INFO [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43695,1676502063240; all regions closed. 2023-02-15 23:01:17,462 DEBUG [RS:1;jenkins-hbase4:43695] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/oldWALs 2023-02-15 23:01:17,462 INFO [RS:1;jenkins-hbase4:43695] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43695%2C1676502063240:(num 1676502066747) 2023-02-15 23:01:17,462 DEBUG [RS:1;jenkins-hbase4:43695] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:17,462 INFO [RS:1;jenkins-hbase4:43695] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:17,463 INFO [RS:1;jenkins-hbase4:43695] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:17,464 INFO [RS:1;jenkins-hbase4:43695] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:17,464 INFO [RS:1;jenkins-hbase4:43695] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:17,464 INFO [RS:1;jenkins-hbase4:43695] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:17,464 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:17,473 INFO [RS:1;jenkins-hbase4:43695] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43695 2023-02-15 23:01:17,485 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:17,485 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:17,485 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43695,1676502063240 2023-02-15 23:01:17,485 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:17,490 ERROR [Listener at localhost/40123-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55f9b2b7 rejected from java.util.concurrent.ThreadPoolExecutor@51c62cd0[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:17,490 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:17,490 ERROR [Listener at localhost/40123-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3d6eeef3 rejected from java.util.concurrent.ThreadPoolExecutor@51c62cd0[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:17,490 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43695,1676502063240] 2023-02-15 23:01:17,491 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43695,1676502063240; numProcessing=1 2023-02-15 23:01:17,493 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/.tmp/info/50804fb3bab340a095bb29bf4ffde044 2023-02-15 23:01:17,493 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43695,1676502063240 already deleted, retry=false 2023-02-15 23:01:17,493 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43695,1676502063240 expired; onlineServers=1 2023-02-15 23:01:17,495 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:17,495 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:17,503 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50804fb3bab340a095bb29bf4ffde044 2023-02-15 23:01:17,517 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/.tmp/rep_barrier/40b058d34a48409ebc6cc3fb13161781 2023-02-15 23:01:17,523 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40b058d34a48409ebc6cc3fb13161781 2023-02-15 23:01:17,534 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/.tmp/table/013d984f41bd4391a64b972b8aef4c6c 2023-02-15 23:01:17,541 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 013d984f41bd4391a64b972b8aef4c6c 2023-02-15 23:01:17,543 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/.tmp/info/50804fb3bab340a095bb29bf4ffde044 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/info/50804fb3bab340a095bb29bf4ffde044 2023-02-15 23:01:17,550 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50804fb3bab340a095bb29bf4ffde044 2023-02-15 23:01:17,550 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/info/50804fb3bab340a095bb29bf4ffde044, entries=30, sequenceid=57, filesize=7.9 K 2023-02-15 23:01:17,552 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/.tmp/rep_barrier/40b058d34a48409ebc6cc3fb13161781 as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/rep_barrier/40b058d34a48409ebc6cc3fb13161781 2023-02-15 23:01:17,559 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40b058d34a48409ebc6cc3fb13161781 2023-02-15 23:01:17,560 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/rep_barrier/40b058d34a48409ebc6cc3fb13161781, entries=10, sequenceid=57, filesize=5.9 K 2023-02-15 23:01:17,561 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/.tmp/table/013d984f41bd4391a64b972b8aef4c6c as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/table/013d984f41bd4391a64b972b8aef4c6c 2023-02-15 23:01:17,567 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 013d984f41bd4391a64b972b8aef4c6c 2023-02-15 23:01:17,567 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/table/013d984f41bd4391a64b972b8aef4c6c, entries=13, sequenceid=57, filesize=5.9 K 2023-02-15 23:01:17,569 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 122ms, sequenceid=57, compaction requested=false 2023-02-15 23:01:17,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-15 23:01:17,580 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 23:01:17,581 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:17,581 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:17,581 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:17,639 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:17,639 INFO [RS:1;jenkins-hbase4:43695] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43695,1676502063240; zookeeper connection closed. 2023-02-15 23:01:17,639 ERROR [Listener at localhost/40123-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@455a873c rejected from java.util.concurrent.ThreadPoolExecutor@51c62cd0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:17,639 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:43695-0x1005a3739cf0002, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:17,639 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7dfe3c6a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7dfe3c6a 2023-02-15 23:01:17,639 ERROR [Listener at localhost/40123-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3eb826db rejected from java.util.concurrent.ThreadPoolExecutor@51c62cd0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:17,649 DEBUG [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1505): Waiting on a3745ab366923d5a288dcc5afe26f918 2023-02-15 23:01:17,674 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 23:01:17,675 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 23:01:17,849 DEBUG [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1505): Waiting on a3745ab366923d5a288dcc5afe26f918 2023-02-15 23:01:17,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/namespace/a3745ab366923d5a288dcc5afe26f918/.tmp/info/a66f39a4eaf0485cafee3c082620b3cb 2023-02-15 23:01:17,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/namespace/a3745ab366923d5a288dcc5afe26f918/.tmp/info/a66f39a4eaf0485cafee3c082620b3cb as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/namespace/a3745ab366923d5a288dcc5afe26f918/info/a66f39a4eaf0485cafee3c082620b3cb 2023-02-15 23:01:17,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/namespace/a3745ab366923d5a288dcc5afe26f918/info/a66f39a4eaf0485cafee3c082620b3cb, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 23:01:17,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a3745ab366923d5a288dcc5afe26f918 in 460ms, sequenceid=6, compaction requested=false 2023-02-15 23:01:17,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/data/hbase/namespace/a3745ab366923d5a288dcc5afe26f918/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 23:01:17,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. 2023-02-15 23:01:17,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a3745ab366923d5a288dcc5afe26f918: 2023-02-15 23:01:17,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676502066311.a3745ab366923d5a288dcc5afe26f918. 2023-02-15 23:01:18,049 INFO [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33507,1676502063190; all regions closed. 2023-02-15 23:01:18,058 DEBUG [RS:0;jenkins-hbase4:33507] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/oldWALs 2023-02-15 23:01:18,058 INFO [RS:0;jenkins-hbase4:33507] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33507%2C1676502063190.meta:.meta(num 1676502066053) 2023-02-15 23:01:18,074 DEBUG [RS:0;jenkins-hbase4:33507] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/oldWALs 2023-02-15 23:01:18,074 INFO [RS:0;jenkins-hbase4:33507] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33507%2C1676502063190:(num 1676502066737) 2023-02-15 23:01:18,074 DEBUG [RS:0;jenkins-hbase4:33507] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:18,074 INFO [RS:0;jenkins-hbase4:33507] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:18,074 INFO [RS:0;jenkins-hbase4:33507] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:18,075 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:18,076 INFO [RS:0;jenkins-hbase4:33507] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33507 2023-02-15 23:01:18,116 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:18,116 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33507,1676502063190 2023-02-15 23:01:18,117 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33507,1676502063190] 2023-02-15 23:01:18,117 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33507,1676502063190; numProcessing=2 2023-02-15 23:01:18,239 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33507,1676502063190 already deleted, retry=false 2023-02-15 23:01:18,239 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33507,1676502063190 expired; onlineServers=0 2023-02-15 23:01:18,239 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44547,1676502061974' ***** 2023-02-15 23:01:18,239 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 23:01:18,240 DEBUG [M:0;jenkins-hbase4:44547] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50ffc3c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:18,240 INFO [M:0;jenkins-hbase4:44547] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44547,1676502061974 2023-02-15 23:01:18,240 INFO [M:0;jenkins-hbase4:44547] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44547,1676502061974; all regions closed. 2023-02-15 23:01:18,240 DEBUG [M:0;jenkins-hbase4:44547] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:18,240 DEBUG [M:0;jenkins-hbase4:44547] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 23:01:18,241 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 23:01:18,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502064571] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502064571,5,FailOnTimeoutGroup] 2023-02-15 23:01:18,241 DEBUG [M:0;jenkins-hbase4:44547] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 23:01:18,242 INFO [M:0;jenkins-hbase4:44547] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 23:01:18,242 INFO [M:0;jenkins-hbase4:44547] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 23:01:18,242 INFO [M:0;jenkins-hbase4:44547] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 23:01:18,242 DEBUG [M:0;jenkins-hbase4:44547] master.HMaster(1512): Stopping service threads 2023-02-15 23:01:18,242 INFO [M:0;jenkins-hbase4:44547] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 23:01:18,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502064573] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502064573,5,FailOnTimeoutGroup] 2023-02-15 23:01:18,245 ERROR [M:0;jenkins-hbase4:44547] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-15 23:01:18,246 INFO [M:0;jenkins-hbase4:44547] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 23:01:18,246 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 23:01:18,277 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:18,277 INFO [RS:0;jenkins-hbase4:33507] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33507,1676502063190; zookeeper connection closed. 2023-02-15 23:01:18,277 ERROR [Listener at localhost/40123-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@237b2172 rejected from java.util.concurrent.ThreadPoolExecutor@2744a1c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:18,278 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): regionserver:33507-0x1005a3739cf0001, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:18,278 ERROR [Listener at localhost/40123-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@29e4acd6 rejected from java.util.concurrent.ThreadPoolExecutor@2744a1c5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:18,278 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4a4467fd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4a4467fd 2023-02-15 23:01:18,279 INFO [Listener at localhost/40123] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 23:01:18,293 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:18,293 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:18,293 DEBUG [M:0;jenkins-hbase4:44547] zookeeper.ZKUtil(398): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 23:01:18,293 WARN [M:0;jenkins-hbase4:44547] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 23:01:18,294 INFO [M:0;jenkins-hbase4:44547] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 23:01:18,294 INFO [M:0;jenkins-hbase4:44547] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 23:01:18,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:18,295 DEBUG [M:0;jenkins-hbase4:44547] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:18,295 INFO [M:0;jenkins-hbase4:44547] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:18,295 DEBUG [M:0;jenkins-hbase4:44547] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:18,295 DEBUG [M:0;jenkins-hbase4:44547] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:18,295 DEBUG [M:0;jenkins-hbase4:44547] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:18,295 INFO [M:0;jenkins-hbase4:44547] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.27 KB heapSize=192.19 KB 2023-02-15 23:01:18,336 INFO [M:0;jenkins-hbase4:44547] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.27 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9152b0652e3b484f80d0f6ae3335088c 2023-02-15 23:01:18,342 DEBUG [M:0;jenkins-hbase4:44547] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9152b0652e3b484f80d0f6ae3335088c as hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9152b0652e3b484f80d0f6ae3335088c 2023-02-15 23:01:18,348 INFO [M:0;jenkins-hbase4:44547] regionserver.HStore(1080): Added hdfs://localhost:41805/user/jenkins/test-data/b36a827c-df50-20b3-d80c-e82a54620964/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9152b0652e3b484f80d0f6ae3335088c, entries=53, sequenceid=357, filesize=10.4 K 2023-02-15 23:01:18,349 INFO [M:0;jenkins-hbase4:44547] regionserver.HRegion(2947): Finished flush of dataSize ~159.27 KB/163094, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 54ms, sequenceid=357, compaction requested=false 2023-02-15 23:01:18,351 INFO [M:0;jenkins-hbase4:44547] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:18,351 DEBUG [M:0;jenkins-hbase4:44547] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:18,354 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:18,354 INFO [M:0;jenkins-hbase4:44547] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 23:01:18,355 INFO [M:0;jenkins-hbase4:44547] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44547 2023-02-15 23:01:18,407 DEBUG [M:0;jenkins-hbase4:44547] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44547,1676502061974 already deleted, retry=false 2023-02-15 23:01:18,562 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:18,562 INFO [M:0;jenkins-hbase4:44547] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44547,1676502061974; zookeeper connection closed. 2023-02-15 23:01:18,562 ERROR [Listener at localhost/40123-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2c79b001 rejected from java.util.concurrent.ThreadPoolExecutor@1723ed0f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:18,562 DEBUG [Listener at localhost/40123-EventThread] zookeeper.ZKWatcher(600): master:44547-0x1005a3739cf0000, quorum=127.0.0.1:64794, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:18,562 ERROR [Listener at localhost/40123-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@657cb60f rejected from java.util.concurrent.ThreadPoolExecutor@1723ed0f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:18,564 WARN [Listener at localhost/40123] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:18,634 INFO [Listener at localhost/40123] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:18,738 WARN [BP-1748612026-172.31.14.131-1676502058586 heartbeating to localhost/127.0.0.1:41805] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 23:01:18,738 WARN [BP-1748612026-172.31.14.131-1676502058586 heartbeating to localhost/127.0.0.1:41805] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1748612026-172.31.14.131-1676502058586 (Datanode Uuid cb0fa7e7-8280-41f0-90ea-499ffad08141) service to localhost/127.0.0.1:41805 2023-02-15 23:01:18,740 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/cluster_f3071d38-6cf6-3266-107c-0e88be1a688a/dfs/data/data3/current/BP-1748612026-172.31.14.131-1676502058586] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:18,740 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/cluster_f3071d38-6cf6-3266-107c-0e88be1a688a/dfs/data/data4/current/BP-1748612026-172.31.14.131-1676502058586] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:18,741 WARN [Listener at localhost/40123] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:18,748 INFO [Listener at localhost/40123] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:18,798 WARN [BP-1748612026-172.31.14.131-1676502058586 heartbeating to localhost/127.0.0.1:41805] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1748612026-172.31.14.131-1676502058586 (Datanode Uuid a153abda-ff9a-4abc-8779-c170c97e2577) service to localhost/127.0.0.1:41805 2023-02-15 23:01:18,798 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/cluster_f3071d38-6cf6-3266-107c-0e88be1a688a/dfs/data/data1/current/BP-1748612026-172.31.14.131-1676502058586] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:18,799 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/cluster_f3071d38-6cf6-3266-107c-0e88be1a688a/dfs/data/data2/current/BP-1748612026-172.31.14.131-1676502058586] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:18,910 INFO [Listener at localhost/40123] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:18,930 INFO [Listener at localhost/40123] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 23:01:19,002 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 23:01:19,018 INFO [Listener at localhost/40123] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=101 (was 7) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:41805 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:41805 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:41805 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:41805 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40123 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44547,1676502061974)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41805 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:41805 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:41805 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@15acc6ec java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=550 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=411 (was 164) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=2869 (was 4111) 2023-02-15 23:01:19,028 INFO [Listener at localhost/40123] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=101, OpenFileDescriptor=550, MaxFileDescriptor=60000, SystemLoadAverage=411, ProcessCount=166, AvailableMemoryMB=2869 2023-02-15 23:01:19,041 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/hadoop.log.dir so I do NOT create it in target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e 2023-02-15 23:01:19,041 WARN [Listener at localhost/40123] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 23:01:19,041 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/hadoop.tmp.dir so I do NOT create it in target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e 2023-02-15 23:01:19,041 WARN [Listener at localhost/40123] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c6eeac4-61cc-8751-090f-4c0ae12dba95/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 23:01:19,041 DEBUG [Listener at localhost/40123] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e 2023-02-15 23:01:19,041 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 23:01:19,041 INFO [Listener at localhost/40123] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/cluster_2cd0fec7-0b23-fe3e-1d62-24f8eb56b933, deleteOnExit=true 2023-02-15 23:01:19,042 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 23:01:19,042 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/test.cache.data in system properties and HBase conf 2023-02-15 23:01:19,042 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 23:01:19,042 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/hadoop.log.dir in system properties and HBase conf 2023-02-15 23:01:19,042 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 23:01:19,042 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 23:01:19,043 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 23:01:19,043 DEBUG [Listener at localhost/40123] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 23:01:19,043 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:01:19,043 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:01:19,043 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 23:01:19,043 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:01:19,043 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 23:01:19,044 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 23:01:19,044 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:01:19,044 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:01:19,044 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 23:01:19,044 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/nfs.dump.dir in system properties and HBase conf 2023-02-15 23:01:19,044 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/java.io.tmpdir in system properties and HBase conf 2023-02-15 23:01:19,044 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:01:19,044 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 23:01:19,045 INFO [Listener at localhost/40123] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 23:01:19,049 WARN [Listener at localhost/40123] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:01:19,049 WARN [Listener at localhost/40123] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:01:20,025 WARN [Listener at localhost/40123] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:20,028 INFO [Listener at localhost/40123] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:20,034 INFO [Listener at localhost/40123] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/java.io.tmpdir/Jetty_localhost_33451_hdfs____wuvspm/webapp 2023-02-15 23:01:20,141 INFO [Listener at localhost/40123] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33451 2023-02-15 23:01:20,146 WARN [Listener at localhost/40123] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:01:20,146 WARN [Listener at localhost/40123] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:01:20,640 WARN [Listener at localhost/44419] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:20,669 WARN [Listener at localhost/44419] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:01:20,672 WARN [Listener at localhost/44419] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:20,673 INFO [Listener at localhost/44419] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:20,679 INFO [Listener at localhost/44419] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/java.io.tmpdir/Jetty_localhost_34523_datanode____.knwndw/webapp 2023-02-15 23:01:20,795 INFO [Listener at localhost/44419] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34523 2023-02-15 23:01:20,807 WARN [Listener at localhost/41903] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:20,846 WARN [Listener at localhost/41903] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:01:20,852 WARN [Listener at localhost/41903] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:20,853 INFO [Listener at localhost/41903] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:20,908 INFO [Listener at localhost/41903] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/java.io.tmpdir/Jetty_localhost_42379_datanode____.v5ctc2/webapp 2023-02-15 23:01:21,027 INFO [Listener at localhost/41903] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42379 2023-02-15 23:01:21,037 WARN [Listener at localhost/45623] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:21,182 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d1b897e0f0a2c2a: Processing first storage report for DS-9ce8449b-c2cc-413e-b41c-5b9435a61c53 from datanode 660d5474-60bb-475e-8a19-99476ecdd02b 2023-02-15 23:01:21,183 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d1b897e0f0a2c2a: from storage DS-9ce8449b-c2cc-413e-b41c-5b9435a61c53 node DatanodeRegistration(127.0.0.1:37571, datanodeUuid=660d5474-60bb-475e-8a19-99476ecdd02b, infoPort=35681, infoSecurePort=0, ipcPort=41903, storageInfo=lv=-57;cid=testClusterID;nsid=1252446893;c=1676502079052), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 23:01:21,183 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d1b897e0f0a2c2a: Processing first storage report for DS-1753360a-8c41-40cd-b5cf-44de8509b894 from datanode 660d5474-60bb-475e-8a19-99476ecdd02b 2023-02-15 23:01:21,183 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d1b897e0f0a2c2a: from storage DS-1753360a-8c41-40cd-b5cf-44de8509b894 node DatanodeRegistration(127.0.0.1:37571, datanodeUuid=660d5474-60bb-475e-8a19-99476ecdd02b, infoPort=35681, infoSecurePort=0, ipcPort=41903, storageInfo=lv=-57;cid=testClusterID;nsid=1252446893;c=1676502079052), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:21,337 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5f73ee036ba63c1b: Processing first storage report for DS-28c3a7bc-d8b1-4143-9fc9-3a0870be8193 from datanode c23a6183-2743-435f-a48a-8a70c19d59ef 2023-02-15 23:01:21,337 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5f73ee036ba63c1b: from storage DS-28c3a7bc-d8b1-4143-9fc9-3a0870be8193 node DatanodeRegistration(127.0.0.1:34373, datanodeUuid=c23a6183-2743-435f-a48a-8a70c19d59ef, infoPort=35995, infoSecurePort=0, ipcPort=45623, storageInfo=lv=-57;cid=testClusterID;nsid=1252446893;c=1676502079052), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:21,338 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5f73ee036ba63c1b: Processing first storage report for DS-ffb4497d-4695-4451-ae62-da52f2276e5c from datanode c23a6183-2743-435f-a48a-8a70c19d59ef 2023-02-15 23:01:21,338 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5f73ee036ba63c1b: from storage DS-ffb4497d-4695-4451-ae62-da52f2276e5c node DatanodeRegistration(127.0.0.1:34373, datanodeUuid=c23a6183-2743-435f-a48a-8a70c19d59ef, infoPort=35995, infoSecurePort=0, ipcPort=45623, storageInfo=lv=-57;cid=testClusterID;nsid=1252446893;c=1676502079052), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 23:01:21,356 DEBUG [Listener at localhost/45623] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e 2023-02-15 23:01:21,359 INFO [Listener at localhost/45623] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/cluster_2cd0fec7-0b23-fe3e-1d62-24f8eb56b933/zookeeper_0, clientPort=61364, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/cluster_2cd0fec7-0b23-fe3e-1d62-24f8eb56b933/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/cluster_2cd0fec7-0b23-fe3e-1d62-24f8eb56b933/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 23:01:21,360 INFO [Listener at localhost/45623] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61364 2023-02-15 23:01:21,360 INFO [Listener at localhost/45623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:21,362 INFO [Listener at localhost/45623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:21,390 INFO [Listener at localhost/45623] util.FSUtils(479): Created version file at hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43 with version=8 2023-02-15 23:01:21,390 INFO [Listener at localhost/45623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:21,392 INFO [Listener at localhost/45623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:21,393 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/hbase-staging 2023-02-15 23:01:21,395 INFO [Listener at localhost/45623] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:21,395 INFO [Listener at localhost/45623] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:21,396 INFO [Listener at localhost/45623] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:21,396 INFO [Listener at localhost/45623] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:21,396 INFO [Listener at localhost/45623] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:21,396 INFO [Listener at localhost/45623] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:21,396 INFO [Listener at localhost/45623] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:21,397 INFO [Listener at localhost/45623] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35535 2023-02-15 23:01:21,398 INFO [Listener at localhost/45623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:21,399 INFO [Listener at localhost/45623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:21,401 INFO [Listener at localhost/45623] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35535 connecting to ZooKeeper ensemble=127.0.0.1:61364 2023-02-15 23:01:21,416 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:355350x0, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:21,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35535-0x1005a3789130000 connected 2023-02-15 23:01:21,436 DEBUG [Listener at localhost/45623] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:21,437 DEBUG [Listener at localhost/45623] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:21,437 DEBUG [Listener at localhost/45623] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:21,444 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35535 2023-02-15 23:01:21,444 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35535 2023-02-15 23:01:21,444 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35535 2023-02-15 23:01:21,445 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35535 2023-02-15 23:01:21,445 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35535 2023-02-15 23:01:21,445 INFO [Listener at localhost/45623] master.HMaster(444): hbase.rootdir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43, hbase.cluster.distributed=false 2023-02-15 23:01:21,459 INFO [Listener at localhost/45623] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:21,459 INFO [Listener at localhost/45623] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:21,459 INFO [Listener at localhost/45623] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:21,459 INFO [Listener at localhost/45623] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:21,459 INFO [Listener at localhost/45623] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:21,459 INFO [Listener at localhost/45623] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:21,460 INFO [Listener at localhost/45623] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:21,463 INFO [Listener at localhost/45623] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42337 2023-02-15 23:01:21,463 INFO [Listener at localhost/45623] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:21,465 DEBUG [Listener at localhost/45623] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:21,465 INFO [Listener at localhost/45623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:21,466 INFO [Listener at localhost/45623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:21,467 INFO [Listener at localhost/45623] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42337 connecting to ZooKeeper ensemble=127.0.0.1:61364 2023-02-15 23:01:21,475 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:423370x0, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:21,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42337-0x1005a3789130001 connected 2023-02-15 23:01:21,476 DEBUG [Listener at localhost/45623] zookeeper.ZKUtil(164): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:21,477 DEBUG [Listener at localhost/45623] zookeeper.ZKUtil(164): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:21,477 DEBUG [Listener at localhost/45623] zookeeper.ZKUtil(164): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:21,479 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42337 2023-02-15 23:01:21,480 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42337 2023-02-15 23:01:21,484 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42337 2023-02-15 23:01:21,484 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42337 2023-02-15 23:01:21,484 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42337 2023-02-15 23:01:21,497 INFO [Listener at localhost/45623] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:21,497 INFO [Listener at localhost/45623] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:21,497 INFO [Listener at localhost/45623] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:21,497 INFO [Listener at localhost/45623] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:21,497 INFO [Listener at localhost/45623] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:21,498 INFO [Listener at localhost/45623] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:21,498 INFO [Listener at localhost/45623] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:21,499 INFO [Listener at localhost/45623] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40177 2023-02-15 23:01:21,500 INFO [Listener at localhost/45623] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:21,501 DEBUG [Listener at localhost/45623] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:21,501 INFO [Listener at localhost/45623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:21,502 INFO [Listener at localhost/45623] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:21,503 INFO [Listener at localhost/45623] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40177 connecting to ZooKeeper ensemble=127.0.0.1:61364 2023-02-15 23:01:21,507 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:401770x0, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:21,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40177-0x1005a3789130002 connected 2023-02-15 23:01:21,508 DEBUG [Listener at localhost/45623] zookeeper.ZKUtil(164): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:21,509 DEBUG [Listener at localhost/45623] zookeeper.ZKUtil(164): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:21,509 DEBUG [Listener at localhost/45623] zookeeper.ZKUtil(164): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:21,514 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40177 2023-02-15 23:01:21,515 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40177 2023-02-15 23:01:21,515 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40177 2023-02-15 23:01:21,516 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40177 2023-02-15 23:01:21,516 DEBUG [Listener at localhost/45623] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40177 2023-02-15 23:01:21,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35535,1676502081395 2023-02-15 23:01:21,519 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:21,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35535,1676502081395 2023-02-15 23:01:21,521 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:21,521 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:21,521 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:21,521 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:21,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:21,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:21,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35535,1676502081395 from backup master directory 2023-02-15 23:01:21,524 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35535,1676502081395 2023-02-15 23:01:21,524 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:21,524 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:21,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35535,1676502081395 2023-02-15 23:01:21,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/hbase.id with ID: ffdacc20-2bb8-4e4f-8f8c-dc0ac310cd05 2023-02-15 23:01:21,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:21,560 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:21,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4b4ddd38 to 127.0.0.1:61364 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:21,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@222e1a1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:21,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:21,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 23:01:21,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:21,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/MasterData/data/master/store-tmp 2023-02-15 23:01:21,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:21,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:21,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:21,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:21,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:21,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:21,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:21,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:21,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/MasterData/WALs/jenkins-hbase4.apache.org,35535,1676502081395 2023-02-15 23:01:21,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35535%2C1676502081395, suffix=, logDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/MasterData/WALs/jenkins-hbase4.apache.org,35535,1676502081395, archiveDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/MasterData/oldWALs, maxLogs=10 2023-02-15 23:01:21,611 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34373,DS-28c3a7bc-d8b1-4143-9fc9-3a0870be8193,DISK] 2023-02-15 23:01:21,619 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37571,DS-9ce8449b-c2cc-413e-b41c-5b9435a61c53,DISK] 2023-02-15 23:01:21,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/MasterData/WALs/jenkins-hbase4.apache.org,35535,1676502081395/jenkins-hbase4.apache.org%2C35535%2C1676502081395.1676502081596 2023-02-15 23:01:21,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34373,DS-28c3a7bc-d8b1-4143-9fc9-3a0870be8193,DISK], DatanodeInfoWithStorage[127.0.0.1:37571,DS-9ce8449b-c2cc-413e-b41c-5b9435a61c53,DISK]] 2023-02-15 23:01:21,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:21,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:21,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:21,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:21,625 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:21,627 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 23:01:21,627 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 23:01:21,628 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:21,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:21,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:21,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:21,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:21,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74776593, jitterRate=0.1142580658197403}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:21,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:21,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 23:01:21,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 23:01:21,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 23:01:21,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 23:01:21,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 23:01:21,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 23:01:21,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 23:01:21,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 23:01:21,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 23:01:21,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 23:01:21,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 23:01:21,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 23:01:21,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 23:01:21,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 23:01:21,660 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:21,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 23:01:21,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 23:01:21,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 23:01:21,662 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:21,663 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:21,663 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:21,663 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:21,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35535,1676502081395, sessionid=0x1005a3789130000, setting cluster-up flag (Was=false) 2023-02-15 23:01:21,672 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:21,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 23:01:21,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35535,1676502081395 2023-02-15 23:01:21,680 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:21,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 23:01:21,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35535,1676502081395 2023-02-15 23:01:21,686 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.hbase-snapshot/.tmp 2023-02-15 23:01:21,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:21,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:21,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:21,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:21,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:21,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 23:01:21,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:21,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676502111698 2023-02-15 23:01:21,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 23:01:21,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 23:01:21,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 23:01:21,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 23:01:21,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 23:01:21,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 23:01:21,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,702 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:21,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 23:01:21,702 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 23:01:21,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 23:01:21,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 23:01:21,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 23:01:21,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 23:01:21,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502081703,5,FailOnTimeoutGroup] 2023-02-15 23:01:21,704 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:21,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502081703,5,FailOnTimeoutGroup] 2023-02-15 23:01:21,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 23:01:21,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,718 INFO [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(952): ClusterId : ffdacc20-2bb8-4e4f-8f8c-dc0ac310cd05 2023-02-15 23:01:21,718 DEBUG [RS:0;jenkins-hbase4:42337] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:21,721 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(952): ClusterId : ffdacc20-2bb8-4e4f-8f8c-dc0ac310cd05 2023-02-15 23:01:21,722 DEBUG [RS:1;jenkins-hbase4:40177] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:21,722 DEBUG [RS:0;jenkins-hbase4:42337] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:21,722 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:21,722 DEBUG [RS:0;jenkins-hbase4:42337] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:21,723 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:21,723 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43 2023-02-15 23:01:21,726 DEBUG [RS:1;jenkins-hbase4:40177] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:21,726 DEBUG [RS:1;jenkins-hbase4:40177] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:21,726 DEBUG [RS:0;jenkins-hbase4:42337] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:21,727 DEBUG [RS:0;jenkins-hbase4:42337] zookeeper.ReadOnlyZKClient(139): Connect 0x00f1f754 to 127.0.0.1:61364 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:21,728 DEBUG [RS:1;jenkins-hbase4:40177] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:21,733 DEBUG [RS:1;jenkins-hbase4:40177] zookeeper.ReadOnlyZKClient(139): Connect 0x65c04ded to 127.0.0.1:61364 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:21,743 DEBUG [RS:0;jenkins-hbase4:42337] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e36193a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:21,743 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:21,743 DEBUG [RS:0;jenkins-hbase4:42337] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a099c24, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:21,744 DEBUG [RS:1;jenkins-hbase4:40177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b07af25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:21,744 DEBUG [RS:1;jenkins-hbase4:40177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f38269d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:21,747 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:21,749 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/info 2023-02-15 23:01:21,749 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:21,750 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:21,750 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:21,751 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:21,751 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:21,752 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:21,752 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:21,753 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/table 2023-02-15 23:01:21,754 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:21,754 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:21,755 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740 2023-02-15 23:01:21,755 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740 2023-02-15 23:01:21,756 DEBUG [RS:1;jenkins-hbase4:40177] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40177 2023-02-15 23:01:21,756 INFO [RS:1;jenkins-hbase4:40177] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:21,756 INFO [RS:1;jenkins-hbase4:40177] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:21,756 DEBUG [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:21,756 DEBUG [RS:0;jenkins-hbase4:42337] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42337 2023-02-15 23:01:21,756 INFO [RS:0;jenkins-hbase4:42337] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:21,756 INFO [RS:0;jenkins-hbase4:42337] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:21,756 DEBUG [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:21,757 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35535,1676502081395 with isa=jenkins-hbase4.apache.org/172.31.14.131:40177, startcode=1676502081496 2023-02-15 23:01:21,757 DEBUG [RS:1;jenkins-hbase4:40177] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:21,757 INFO [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35535,1676502081395 with isa=jenkins-hbase4.apache.org/172.31.14.131:42337, startcode=1676502081458 2023-02-15 23:01:21,757 DEBUG [RS:0;jenkins-hbase4:42337] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:21,758 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:21,760 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:21,766 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:21,767 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37219, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:21,767 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45271, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:21,767 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74194982, jitterRate=0.10559138655662537}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:21,767 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:21,767 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:21,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35535] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:21,768 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:21,768 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:21,768 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:21,769 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:21,769 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:21,769 DEBUG [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43 2023-02-15 23:01:21,769 DEBUG [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43 2023-02-15 23:01:21,769 DEBUG [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44419 2023-02-15 23:01:21,769 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:21,769 DEBUG [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44419 2023-02-15 23:01:21,769 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:21,769 DEBUG [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:21,769 DEBUG [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:21,771 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:21,771 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 23:01:21,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 23:01:21,772 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 23:01:21,775 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 23:01:21,775 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:21,775 DEBUG [RS:0;jenkins-hbase4:42337] zookeeper.ZKUtil(162): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:21,775 DEBUG [RS:1;jenkins-hbase4:40177] zookeeper.ZKUtil(162): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:21,775 WARN [RS:0;jenkins-hbase4:42337] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:21,776 WARN [RS:1;jenkins-hbase4:40177] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:21,776 INFO [RS:0;jenkins-hbase4:42337] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:21,776 INFO [RS:1;jenkins-hbase4:40177] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:21,776 DEBUG [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/WALs/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:21,776 DEBUG [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/WALs/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:21,782 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42337,1676502081458] 2023-02-15 23:01:21,782 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40177,1676502081496] 2023-02-15 23:01:21,786 DEBUG [RS:1;jenkins-hbase4:40177] zookeeper.ZKUtil(162): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:21,786 DEBUG [RS:0;jenkins-hbase4:42337] zookeeper.ZKUtil(162): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:21,786 DEBUG [RS:1;jenkins-hbase4:40177] zookeeper.ZKUtil(162): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:21,786 DEBUG [RS:0;jenkins-hbase4:42337] zookeeper.ZKUtil(162): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:21,787 DEBUG [RS:1;jenkins-hbase4:40177] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:21,787 DEBUG [RS:0;jenkins-hbase4:42337] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:21,787 INFO [RS:1;jenkins-hbase4:40177] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:21,788 INFO [RS:0;jenkins-hbase4:42337] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:21,790 INFO [RS:1;jenkins-hbase4:40177] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:21,791 INFO [RS:0;jenkins-hbase4:42337] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:21,791 INFO [RS:1;jenkins-hbase4:40177] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:21,791 INFO [RS:1;jenkins-hbase4:40177] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,792 INFO [RS:0;jenkins-hbase4:42337] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:21,792 INFO [RS:0;jenkins-hbase4:42337] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,792 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:21,793 INFO [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:21,794 INFO [RS:1;jenkins-hbase4:40177] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,794 INFO [RS:0;jenkins-hbase4:42337] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,794 DEBUG [RS:1;jenkins-hbase4:40177] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:0;jenkins-hbase4:42337] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:1;jenkins-hbase4:40177] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:0;jenkins-hbase4:42337] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:1;jenkins-hbase4:40177] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:0;jenkins-hbase4:42337] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:1;jenkins-hbase4:40177] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:0;jenkins-hbase4:42337] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:1;jenkins-hbase4:40177] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:0;jenkins-hbase4:42337] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:1;jenkins-hbase4:40177] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:21,795 DEBUG [RS:0;jenkins-hbase4:42337] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:21,795 DEBUG [RS:1;jenkins-hbase4:40177] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:0;jenkins-hbase4:42337] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:1;jenkins-hbase4:40177] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:0;jenkins-hbase4:42337] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:1;jenkins-hbase4:40177] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,795 DEBUG [RS:0;jenkins-hbase4:42337] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,796 DEBUG [RS:1;jenkins-hbase4:40177] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,796 DEBUG [RS:0;jenkins-hbase4:42337] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:21,804 INFO [RS:1;jenkins-hbase4:40177] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,804 INFO [RS:1;jenkins-hbase4:40177] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,804 INFO [RS:1;jenkins-hbase4:40177] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,804 INFO [RS:0;jenkins-hbase4:42337] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,804 INFO [RS:0;jenkins-hbase4:42337] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,804 INFO [RS:0;jenkins-hbase4:42337] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,815 INFO [RS:1;jenkins-hbase4:40177] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:21,815 INFO [RS:1;jenkins-hbase4:40177] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40177,1676502081496-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,823 INFO [RS:0;jenkins-hbase4:42337] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:21,823 INFO [RS:0;jenkins-hbase4:42337] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42337,1676502081458-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:21,830 INFO [RS:1;jenkins-hbase4:40177] regionserver.Replication(203): jenkins-hbase4.apache.org,40177,1676502081496 started 2023-02-15 23:01:21,830 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40177,1676502081496, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40177, sessionid=0x1005a3789130002 2023-02-15 23:01:21,830 DEBUG [RS:1;jenkins-hbase4:40177] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:21,830 DEBUG [RS:1;jenkins-hbase4:40177] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:21,830 DEBUG [RS:1;jenkins-hbase4:40177] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40177,1676502081496' 2023-02-15 23:01:21,830 DEBUG [RS:1;jenkins-hbase4:40177] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:21,831 DEBUG [RS:1;jenkins-hbase4:40177] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:21,831 DEBUG [RS:1;jenkins-hbase4:40177] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:21,831 DEBUG [RS:1;jenkins-hbase4:40177] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:21,831 DEBUG [RS:1;jenkins-hbase4:40177] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:21,831 DEBUG [RS:1;jenkins-hbase4:40177] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40177,1676502081496' 2023-02-15 23:01:21,831 DEBUG [RS:1;jenkins-hbase4:40177] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:21,831 DEBUG [RS:1;jenkins-hbase4:40177] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:21,832 DEBUG [RS:1;jenkins-hbase4:40177] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:21,832 INFO [RS:1;jenkins-hbase4:40177] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:21,832 INFO [RS:1;jenkins-hbase4:40177] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:21,839 INFO [RS:0;jenkins-hbase4:42337] regionserver.Replication(203): jenkins-hbase4.apache.org,42337,1676502081458 started 2023-02-15 23:01:21,839 INFO [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42337,1676502081458, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42337, sessionid=0x1005a3789130001 2023-02-15 23:01:21,839 DEBUG [RS:0;jenkins-hbase4:42337] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:21,839 DEBUG [RS:0;jenkins-hbase4:42337] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:21,839 DEBUG [RS:0;jenkins-hbase4:42337] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42337,1676502081458' 2023-02-15 23:01:21,839 DEBUG [RS:0;jenkins-hbase4:42337] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:21,839 DEBUG [RS:0;jenkins-hbase4:42337] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:21,840 DEBUG [RS:0;jenkins-hbase4:42337] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:21,840 DEBUG [RS:0;jenkins-hbase4:42337] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:21,840 DEBUG [RS:0;jenkins-hbase4:42337] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:21,840 DEBUG [RS:0;jenkins-hbase4:42337] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42337,1676502081458' 2023-02-15 23:01:21,840 DEBUG [RS:0;jenkins-hbase4:42337] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:21,840 DEBUG [RS:0;jenkins-hbase4:42337] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:21,841 DEBUG [RS:0;jenkins-hbase4:42337] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:21,841 INFO [RS:0;jenkins-hbase4:42337] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:21,841 INFO [RS:0;jenkins-hbase4:42337] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:21,925 DEBUG [jenkins-hbase4:35535] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 23:01:21,925 DEBUG [jenkins-hbase4:35535] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:21,927 DEBUG [jenkins-hbase4:35535] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:21,927 DEBUG [jenkins-hbase4:35535] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:21,927 DEBUG [jenkins-hbase4:35535] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:21,928 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40177,1676502081496, state=OPENING 2023-02-15 23:01:21,930 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 23:01:21,931 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:21,931 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:21,931 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40177,1676502081496}] 2023-02-15 23:01:22,086 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:22,086 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:22,089 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48442, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:22,093 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 23:01:22,093 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:22,095 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40177%2C1676502081496.meta, suffix=.meta, logDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/WALs/jenkins-hbase4.apache.org,40177,1676502081496, archiveDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/oldWALs, maxLogs=32 2023-02-15 23:01:22,110 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37571,DS-9ce8449b-c2cc-413e-b41c-5b9435a61c53,DISK] 2023-02-15 23:01:22,110 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34373,DS-28c3a7bc-d8b1-4143-9fc9-3a0870be8193,DISK] 2023-02-15 23:01:22,114 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/WALs/jenkins-hbase4.apache.org,40177,1676502081496/jenkins-hbase4.apache.org%2C40177%2C1676502081496.meta.1676502082096.meta 2023-02-15 23:01:22,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37571,DS-9ce8449b-c2cc-413e-b41c-5b9435a61c53,DISK], DatanodeInfoWithStorage[127.0.0.1:34373,DS-28c3a7bc-d8b1-4143-9fc9-3a0870be8193,DISK]] 2023-02-15 23:01:22,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:22,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 23:01:22,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 23:01:22,115 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 23:01:22,115 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 23:01:22,115 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:22,115 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 23:01:22,115 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 23:01:22,117 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:22,118 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/info 2023-02-15 23:01:22,118 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/info 2023-02-15 23:01:22,118 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:22,119 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:22,119 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:22,120 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:22,120 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:22,120 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:22,121 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:22,121 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:22,122 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/table 2023-02-15 23:01:22,122 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/table 2023-02-15 23:01:22,122 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:22,123 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:22,123 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740 2023-02-15 23:01:22,125 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740 2023-02-15 23:01:22,127 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:22,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:22,129 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68790325, jitterRate=0.025055721402168274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:22,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:22,130 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676502082086 2023-02-15 23:01:22,133 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 23:01:22,134 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 23:01:22,134 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40177,1676502081496, state=OPEN 2023-02-15 23:01:22,136 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 23:01:22,136 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:22,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 23:01:22,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40177,1676502081496 in 205 msec 2023-02-15 23:01:22,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 23:01:22,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 367 msec 2023-02-15 23:01:22,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 453 msec 2023-02-15 23:01:22,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676502082142, completionTime=-1 2023-02-15 23:01:22,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 23:01:22,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 23:01:22,146 DEBUG [hconnection-0x1517415d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:22,148 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48454, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:22,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 23:01:22,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676502142151 2023-02-15 23:01:22,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676502202151 2023-02-15 23:01:22,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 8 msec 2023-02-15 23:01:22,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35535,1676502081395-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:22,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35535,1676502081395-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:22,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35535,1676502081395-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:22,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35535, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:22,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:22,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 23:01:22,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:22,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 23:01:22,163 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:22,163 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 23:01:22,164 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:22,166 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/hbase/namespace/1b57104861a95645904bd5b9e8b07eb1 2023-02-15 23:01:22,166 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/hbase/namespace/1b57104861a95645904bd5b9e8b07eb1 empty. 2023-02-15 23:01:22,167 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/hbase/namespace/1b57104861a95645904bd5b9e8b07eb1 2023-02-15 23:01:22,167 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 23:01:22,185 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:22,187 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1b57104861a95645904bd5b9e8b07eb1, NAME => 'hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp 2023-02-15 23:01:22,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:22,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 1b57104861a95645904bd5b9e8b07eb1, disabling compactions & flushes 2023-02-15 23:01:22,199 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. 2023-02-15 23:01:22,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. 2023-02-15 23:01:22,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. after waiting 0 ms 2023-02-15 23:01:22,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. 2023-02-15 23:01:22,199 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. 2023-02-15 23:01:22,199 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 1b57104861a95645904bd5b9e8b07eb1: 2023-02-15 23:01:22,202 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:22,204 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502082204"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502082204"}]},"ts":"1676502082204"} 2023-02-15 23:01:22,207 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 23:01:22,209 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:22,209 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502082209"}]},"ts":"1676502082209"} 2023-02-15 23:01:22,211 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 23:01:22,214 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:22,215 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:22,215 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:22,215 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:22,215 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1b57104861a95645904bd5b9e8b07eb1, ASSIGN}] 2023-02-15 23:01:22,217 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1b57104861a95645904bd5b9e8b07eb1, ASSIGN 2023-02-15 23:01:22,218 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1b57104861a95645904bd5b9e8b07eb1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40177,1676502081496; forceNewPlan=false, retain=false 2023-02-15 23:01:22,369 INFO [jenkins-hbase4:35535] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 23:01:22,370 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1b57104861a95645904bd5b9e8b07eb1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:22,370 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502082370"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502082370"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502082370"}]},"ts":"1676502082370"} 2023-02-15 23:01:22,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1b57104861a95645904bd5b9e8b07eb1, server=jenkins-hbase4.apache.org,40177,1676502081496}] 2023-02-15 23:01:22,521 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 23:01:22,531 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. 2023-02-15 23:01:22,533 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40177%2C1676502081496, suffix=, logDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/WALs/jenkins-hbase4.apache.org,40177,1676502081496, archiveDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/oldWALs, maxLogs=32 2023-02-15 23:01:22,563 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34373,DS-28c3a7bc-d8b1-4143-9fc9-3a0870be8193,DISK] 2023-02-15 23:01:22,563 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37571,DS-9ce8449b-c2cc-413e-b41c-5b9435a61c53,DISK] 2023-02-15 23:01:22,568 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/WALs/jenkins-hbase4.apache.org,40177,1676502081496/jenkins-hbase4.apache.org%2C40177%2C1676502081496.1676502082534 2023-02-15 23:01:22,572 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37571,DS-9ce8449b-c2cc-413e-b41c-5b9435a61c53,DISK], DatanodeInfoWithStorage[127.0.0.1:34373,DS-28c3a7bc-d8b1-4143-9fc9-3a0870be8193,DISK]] 2023-02-15 23:01:22,572 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1b57104861a95645904bd5b9e8b07eb1, NAME => 'hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:22,572 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1b57104861a95645904bd5b9e8b07eb1 2023-02-15 23:01:22,572 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:22,572 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1b57104861a95645904bd5b9e8b07eb1 2023-02-15 23:01:22,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1b57104861a95645904bd5b9e8b07eb1 2023-02-15 23:01:22,575 INFO [StoreOpener-1b57104861a95645904bd5b9e8b07eb1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1b57104861a95645904bd5b9e8b07eb1 2023-02-15 23:01:22,577 DEBUG [StoreOpener-1b57104861a95645904bd5b9e8b07eb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/namespace/1b57104861a95645904bd5b9e8b07eb1/info 2023-02-15 23:01:22,578 DEBUG [StoreOpener-1b57104861a95645904bd5b9e8b07eb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/namespace/1b57104861a95645904bd5b9e8b07eb1/info 2023-02-15 23:01:22,578 INFO [StoreOpener-1b57104861a95645904bd5b9e8b07eb1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b57104861a95645904bd5b9e8b07eb1 columnFamilyName info 2023-02-15 23:01:22,579 INFO [StoreOpener-1b57104861a95645904bd5b9e8b07eb1-1] regionserver.HStore(310): Store=1b57104861a95645904bd5b9e8b07eb1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:22,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/namespace/1b57104861a95645904bd5b9e8b07eb1 2023-02-15 23:01:22,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/namespace/1b57104861a95645904bd5b9e8b07eb1 2023-02-15 23:01:22,588 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1b57104861a95645904bd5b9e8b07eb1 2023-02-15 23:01:22,593 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/namespace/1b57104861a95645904bd5b9e8b07eb1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:22,594 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1b57104861a95645904bd5b9e8b07eb1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72038862, jitterRate=0.07346269488334656}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:22,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1b57104861a95645904bd5b9e8b07eb1: 2023-02-15 23:01:22,595 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1., pid=6, masterSystemTime=1676502082526 2023-02-15 23:01:22,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. 2023-02-15 23:01:22,597 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. 2023-02-15 23:01:22,598 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1b57104861a95645904bd5b9e8b07eb1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:22,598 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502082598"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502082598"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502082598"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502082598"}]},"ts":"1676502082598"} 2023-02-15 23:01:22,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 23:01:22,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1b57104861a95645904bd5b9e8b07eb1, server=jenkins-hbase4.apache.org,40177,1676502081496 in 228 msec 2023-02-15 23:01:22,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 23:01:22,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1b57104861a95645904bd5b9e8b07eb1, ASSIGN in 387 msec 2023-02-15 23:01:22,604 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:22,604 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502082604"}]},"ts":"1676502082604"} 2023-02-15 23:01:22,606 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 23:01:22,609 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:22,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 449 msec 2023-02-15 23:01:22,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 23:01:22,665 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:22,665 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:22,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 23:01:22,678 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:22,681 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-15 23:01:22,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 23:01:22,699 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:22,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-15 23:01:22,715 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 23:01:22,718 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 23:01:22,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.194sec 2023-02-15 23:01:22,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 23:01:22,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 23:01:22,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 23:01:22,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35535,1676502081395-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 23:01:22,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35535,1676502081395-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 23:01:22,722 DEBUG [Listener at localhost/45623] zookeeper.ReadOnlyZKClient(139): Connect 0x57997cd3 to 127.0.0.1:61364 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:22,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 23:01:22,731 DEBUG [Listener at localhost/45623] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37db08fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:22,733 DEBUG [hconnection-0x25e2c5f9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:22,736 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48458, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:22,737 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35535,1676502081395 2023-02-15 23:01:22,737 DEBUG [Listener at localhost/45623] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 23:01:22,740 DEBUG [Listener at localhost/45623] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 23:01:22,742 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49818, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 23:01:22,742 INFO [Listener at localhost/45623] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 23:01:22,743 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 23:01:22,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 23:01:22,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:49818 deadline: 1676502142742, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-15 23:01:22,743 INFO [Listener at localhost/45623] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-15 23:01:22,745 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:22,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-15 23:01:22,748 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:22,749 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-15 23:01:22,749 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:22,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:22,757 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:22,758 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:22,758 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:22,758 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:22,758 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:22,758 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965 2023-02-15 23:01:22,758 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:22,758 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:22,758 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d empty. 2023-02-15 23:01:22,758 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff empty. 2023-02-15 23:01:22,758 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965 empty. 2023-02-15 23:01:22,759 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f empty. 2023-02-15 23:01:22,759 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59 empty. 2023-02-15 23:01:22,759 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/e607e14d285a83ed1504025b564b08b5 empty. 2023-02-15 23:01:22,758 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17 empty. 2023-02-15 23:01:22,759 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554 empty. 2023-02-15 23:01:22,759 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:22,759 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89 2023-02-15 23:01:22,759 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965 2023-02-15 23:01:22,759 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:22,759 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:22,759 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:22,760 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:22,759 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:22,759 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:22,760 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89 empty. 2023-02-15 23:01:22,760 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:22,760 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89 2023-02-15 23:01:22,760 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/be65b27959e3e6148503368d367bb9c8 empty. 2023-02-15 23:01:22,761 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:22,761 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 23:01:22,774 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:22,776 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => a3ca5e20630f4094ffb524cfe766fc59, NAME => 'testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp 2023-02-15 23:01:22,776 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e607e14d285a83ed1504025b564b08b5, NAME => 'testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp 2023-02-15 23:01:22,776 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 84a276df1e06cbad7d635e079454f90f, NAME => 'testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp 2023-02-15 23:01:22,795 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:22,795 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing a3ca5e20630f4094ffb524cfe766fc59, disabling compactions & flushes 2023-02-15 23:01:22,795 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:22,795 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:22,795 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. after waiting 0 ms 2023-02-15 23:01:22,795 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:22,795 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:22,795 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:22,796 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 84a276df1e06cbad7d635e079454f90f, disabling compactions & flushes 2023-02-15 23:01:22,796 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for a3ca5e20630f4094ffb524cfe766fc59: 2023-02-15 23:01:22,796 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:22,796 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:22,796 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. after waiting 0 ms 2023-02-15 23:01:22,796 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:22,796 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7f512703cd1cf77f16739c1668e6bf17, NAME => 'testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp 2023-02-15 23:01:22,796 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:22,796 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 84a276df1e06cbad7d635e079454f90f: 2023-02-15 23:01:22,797 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3f67bab442b50e260b213bb216916965, NAME => 'testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp 2023-02-15 23:01:22,797 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:22,797 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e607e14d285a83ed1504025b564b08b5, disabling compactions & flushes 2023-02-15 23:01:22,797 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:22,797 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:22,797 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. after waiting 0 ms 2023-02-15 23:01:22,797 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:22,797 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:22,798 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e607e14d285a83ed1504025b564b08b5: 2023-02-15 23:01:22,798 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f0410aee6a8c37d5108bfc4e72e112ff, NAME => 'testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp 2023-02-15 23:01:22,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:22,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:22,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 3f67bab442b50e260b213bb216916965, disabling compactions & flushes 2023-02-15 23:01:22,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 7f512703cd1cf77f16739c1668e6bf17, disabling compactions & flushes 2023-02-15 23:01:22,815 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:22,815 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:22,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:22,816 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:22,816 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. after waiting 0 ms 2023-02-15 23:01:22,816 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. after waiting 0 ms 2023-02-15 23:01:22,816 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:22,816 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:22,816 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:22,816 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:22,816 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 3f67bab442b50e260b213bb216916965: 2023-02-15 23:01:22,816 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 7f512703cd1cf77f16739c1668e6bf17: 2023-02-15 23:01:22,816 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 20ea34416c70729c1f49ad26d44cc554, NAME => 'testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp 2023-02-15 23:01:22,817 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0c9883f7fe6f5e63fd6edafb3e54b69d, NAME => 'testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp 2023-02-15 23:01:22,817 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:22,817 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f0410aee6a8c37d5108bfc4e72e112ff, disabling compactions & flushes 2023-02-15 23:01:22,817 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:22,817 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:22,817 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. after waiting 0 ms 2023-02-15 23:01:22,817 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:22,817 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:22,817 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f0410aee6a8c37d5108bfc4e72e112ff: 2023-02-15 23:01:22,818 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0812508db509f468361033bc0fee2f89, NAME => 'testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp 2023-02-15 23:01:22,823 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:22,824 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 0c9883f7fe6f5e63fd6edafb3e54b69d, disabling compactions & flushes 2023-02-15 23:01:22,824 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:22,824 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:22,824 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. after waiting 0 ms 2023-02-15 23:01:22,824 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:22,824 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:22,824 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 0c9883f7fe6f5e63fd6edafb3e54b69d: 2023-02-15 23:01:22,824 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => be65b27959e3e6148503368d367bb9c8, NAME => 'testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.tmp 2023-02-15 23:01:22,827 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:22,827 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 20ea34416c70729c1f49ad26d44cc554, disabling compactions & flushes 2023-02-15 23:01:22,827 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:22,828 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:22,828 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. after waiting 0 ms 2023-02-15 23:01:22,828 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:22,828 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:22,828 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 20ea34416c70729c1f49ad26d44cc554: 2023-02-15 23:01:22,828 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:22,828 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 0812508db509f468361033bc0fee2f89, disabling compactions & flushes 2023-02-15 23:01:22,828 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:22,828 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:22,828 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. after waiting 0 ms 2023-02-15 23:01:22,828 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:22,828 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:22,828 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 0812508db509f468361033bc0fee2f89: 2023-02-15 23:01:22,831 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:22,831 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing be65b27959e3e6148503368d367bb9c8, disabling compactions & flushes 2023-02-15 23:01:22,831 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:22,831 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:22,831 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. after waiting 0 ms 2023-02-15 23:01:22,831 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:22,831 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:22,831 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for be65b27959e3e6148503368d367bb9c8: 2023-02-15 23:01:22,834 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:22,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502082834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502082834"}]},"ts":"1676502082834"} 2023-02-15 23:01:22,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502082834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502082834"}]},"ts":"1676502082834"} 2023-02-15 23:01:22,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502082834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502082834"}]},"ts":"1676502082834"} 2023-02-15 23:01:22,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676502082745.3f67bab442b50e260b213bb216916965.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502082834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502082834"}]},"ts":"1676502082834"} 2023-02-15 23:01:22,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502082834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502082834"}]},"ts":"1676502082834"} 2023-02-15 23:01:22,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502082834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502082834"}]},"ts":"1676502082834"} 2023-02-15 23:01:22,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502082834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502082834"}]},"ts":"1676502082834"} 2023-02-15 23:01:22,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502082834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502082834"}]},"ts":"1676502082834"} 2023-02-15 23:01:22,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502082834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502082834"}]},"ts":"1676502082834"} 2023-02-15 23:01:22,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502082834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502082834"}]},"ts":"1676502082834"} 2023-02-15 23:01:22,838 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-15 23:01:22,839 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:22,840 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502082840"}]},"ts":"1676502082840"} 2023-02-15 23:01:22,842 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-15 23:01:22,843 INFO [RS:0;jenkins-hbase4:42337] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42337%2C1676502081458, suffix=, logDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/WALs/jenkins-hbase4.apache.org,42337,1676502081458, archiveDir=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/oldWALs, maxLogs=32 2023-02-15 23:01:22,847 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:22,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:22,856 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:22,856 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:22,856 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:22,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e607e14d285a83ed1504025b564b08b5, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=84a276df1e06cbad7d635e079454f90f, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a3ca5e20630f4094ffb524cfe766fc59, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7f512703cd1cf77f16739c1668e6bf17, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3f67bab442b50e260b213bb216916965, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f0410aee6a8c37d5108bfc4e72e112ff, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=20ea34416c70729c1f49ad26d44cc554, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0c9883f7fe6f5e63fd6edafb3e54b69d, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0812508db509f468361033bc0fee2f89, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=be65b27959e3e6148503368d367bb9c8, ASSIGN}] 2023-02-15 23:01:22,859 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e607e14d285a83ed1504025b564b08b5, ASSIGN 2023-02-15 23:01:22,859 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=84a276df1e06cbad7d635e079454f90f, ASSIGN 2023-02-15 23:01:22,860 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3f67bab442b50e260b213bb216916965, ASSIGN 2023-02-15 23:01:22,860 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7f512703cd1cf77f16739c1668e6bf17, ASSIGN 2023-02-15 23:01:22,861 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e607e14d285a83ed1504025b564b08b5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42337,1676502081458; forceNewPlan=false, retain=false 2023-02-15 23:01:22,861 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=84a276df1e06cbad7d635e079454f90f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40177,1676502081496; forceNewPlan=false, retain=false 2023-02-15 23:01:22,863 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3f67bab442b50e260b213bb216916965, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40177,1676502081496; forceNewPlan=false, retain=false 2023-02-15 23:01:22,863 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=be65b27959e3e6148503368d367bb9c8, ASSIGN 2023-02-15 23:01:22,864 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0812508db509f468361033bc0fee2f89, ASSIGN 2023-02-15 23:01:22,865 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0c9883f7fe6f5e63fd6edafb3e54b69d, ASSIGN 2023-02-15 23:01:22,865 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7f512703cd1cf77f16739c1668e6bf17, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42337,1676502081458; forceNewPlan=false, retain=false 2023-02-15 23:01:22,866 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34373,DS-28c3a7bc-d8b1-4143-9fc9-3a0870be8193,DISK] 2023-02-15 23:01:22,866 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=be65b27959e3e6148503368d367bb9c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40177,1676502081496; forceNewPlan=false, retain=false 2023-02-15 23:01:22,867 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=20ea34416c70729c1f49ad26d44cc554, ASSIGN 2023-02-15 23:01:22,868 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0c9883f7fe6f5e63fd6edafb3e54b69d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42337,1676502081458; forceNewPlan=false, retain=false 2023-02-15 23:01:22,873 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37571,DS-9ce8449b-c2cc-413e-b41c-5b9435a61c53,DISK] 2023-02-15 23:01:22,873 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0812508db509f468361033bc0fee2f89, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42337,1676502081458; forceNewPlan=false, retain=false 2023-02-15 23:01:22,874 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f0410aee6a8c37d5108bfc4e72e112ff, ASSIGN 2023-02-15 23:01:22,874 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=20ea34416c70729c1f49ad26d44cc554, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40177,1676502081496; forceNewPlan=false, retain=false 2023-02-15 23:01:22,874 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a3ca5e20630f4094ffb524cfe766fc59, ASSIGN 2023-02-15 23:01:22,876 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f0410aee6a8c37d5108bfc4e72e112ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40177,1676502081496; forceNewPlan=false, retain=false 2023-02-15 23:01:22,876 INFO [RS:0;jenkins-hbase4:42337] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/WALs/jenkins-hbase4.apache.org,42337,1676502081458/jenkins-hbase4.apache.org%2C42337%2C1676502081458.1676502082844 2023-02-15 23:01:22,876 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a3ca5e20630f4094ffb524cfe766fc59, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42337,1676502081458; forceNewPlan=false, retain=false 2023-02-15 23:01:22,876 DEBUG [RS:0;jenkins-hbase4:42337] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34373,DS-28c3a7bc-d8b1-4143-9fc9-3a0870be8193,DISK], DatanodeInfoWithStorage[127.0.0.1:37571,DS-9ce8449b-c2cc-413e-b41c-5b9435a61c53,DISK]] 2023-02-15 23:01:23,011 INFO [jenkins-hbase4:35535] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-15 23:01:23,015 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0812508db509f468361033bc0fee2f89, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,015 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=0c9883f7fe6f5e63fd6edafb3e54b69d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,015 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a3ca5e20630f4094ffb524cfe766fc59, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,015 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7f512703cd1cf77f16739c1668e6bf17, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,015 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502083015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502083015"}]},"ts":"1676502083015"} 2023-02-15 23:01:23,015 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e607e14d285a83ed1504025b564b08b5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,016 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502083015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502083015"}]},"ts":"1676502083015"} 2023-02-15 23:01:23,016 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502083015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502083015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502083015"}]},"ts":"1676502083015"} 2023-02-15 23:01:23,015 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502083015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502083015"}]},"ts":"1676502083015"} 2023-02-15 23:01:23,015 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502083015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502083015"}]},"ts":"1676502083015"} 2023-02-15 23:01:23,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure 0c9883f7fe6f5e63fd6edafb3e54b69d, server=jenkins-hbase4.apache.org,42337,1676502081458}] 2023-02-15 23:01:23,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure 7f512703cd1cf77f16739c1668e6bf17, server=jenkins-hbase4.apache.org,42337,1676502081458}] 2023-02-15 23:01:23,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure e607e14d285a83ed1504025b564b08b5, server=jenkins-hbase4.apache.org,42337,1676502081458}] 2023-02-15 23:01:23,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=13, state=RUNNABLE; OpenRegionProcedure a3ca5e20630f4094ffb524cfe766fc59, server=jenkins-hbase4.apache.org,42337,1676502081458}] 2023-02-15 23:01:23,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure 0812508db509f468361033bc0fee2f89, server=jenkins-hbase4.apache.org,42337,1676502081458}] 2023-02-15 23:01:23,024 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3f67bab442b50e260b213bb216916965, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,024 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676502082745.3f67bab442b50e260b213bb216916965.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502083023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502083023"}]},"ts":"1676502083023"} 2023-02-15 23:01:23,025 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=84a276df1e06cbad7d635e079454f90f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,025 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083025"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502083025"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502083025"}]},"ts":"1676502083025"} 2023-02-15 23:01:23,026 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=20ea34416c70729c1f49ad26d44cc554, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,026 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083026"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502083026"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502083026"}]},"ts":"1676502083026"} 2023-02-15 23:01:23,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure 3f67bab442b50e260b213bb216916965, server=jenkins-hbase4.apache.org,40177,1676502081496}] 2023-02-15 23:01:23,030 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f0410aee6a8c37d5108bfc4e72e112ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,030 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083030"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502083030"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502083030"}]},"ts":"1676502083030"} 2023-02-15 23:01:23,030 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure 20ea34416c70729c1f49ad26d44cc554, server=jenkins-hbase4.apache.org,40177,1676502081496}] 2023-02-15 23:01:23,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure 84a276df1e06cbad7d635e079454f90f, server=jenkins-hbase4.apache.org,40177,1676502081496}] 2023-02-15 23:01:23,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure f0410aee6a8c37d5108bfc4e72e112ff, server=jenkins-hbase4.apache.org,40177,1676502081496}] 2023-02-15 23:01:23,036 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=be65b27959e3e6148503368d367bb9c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,036 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502083036"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502083036"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502083036"}]},"ts":"1676502083036"} 2023-02-15 23:01:23,038 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=20, state=RUNNABLE; OpenRegionProcedure be65b27959e3e6148503368d367bb9c8, server=jenkins-hbase4.apache.org,40177,1676502081496}] 2023-02-15 23:01:23,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:23,170 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,170 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:23,174 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35106, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:23,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:23,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7f512703cd1cf77f16739c1668e6bf17, NAME => 'testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-15 23:01:23,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:23,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:23,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:23,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:23,181 INFO [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:23,182 DEBUG [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f1 2023-02-15 23:01:23,182 DEBUG [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f1 2023-02-15 23:01:23,182 INFO [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f512703cd1cf77f16739c1668e6bf17 columnFamilyName f1 2023-02-15 23:01:23,183 INFO [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] regionserver.HStore(310): Store=7f512703cd1cf77f16739c1668e6bf17/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,183 INFO [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:23,184 DEBUG [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f2 2023-02-15 23:01:23,184 DEBUG [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f2 2023-02-15 23:01:23,185 INFO [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f512703cd1cf77f16739c1668e6bf17 columnFamilyName f2 2023-02-15 23:01:23,185 INFO [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] regionserver.HStore(310): Store=7f512703cd1cf77f16739c1668e6bf17/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:23,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:23,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:23,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:23,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 84a276df1e06cbad7d635e079454f90f, NAME => 'testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-15 23:01:23,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:23,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:23,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:23,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:23,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:23,191 INFO [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:23,194 DEBUG [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f1 2023-02-15 23:01:23,194 DEBUG [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f1 2023-02-15 23:01:23,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:23,194 INFO [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84a276df1e06cbad7d635e079454f90f columnFamilyName f1 2023-02-15 23:01:23,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7f512703cd1cf77f16739c1668e6bf17; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65324779, jitterRate=-0.026584938168525696}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:23,194 INFO [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] regionserver.HStore(310): Store=84a276df1e06cbad7d635e079454f90f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7f512703cd1cf77f16739c1668e6bf17: 2023-02-15 23:01:23,194 INFO [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:23,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17., pid=22, masterSystemTime=1676502083170 2023-02-15 23:01:23,197 DEBUG [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f2 2023-02-15 23:01:23,197 DEBUG [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f2 2023-02-15 23:01:23,198 INFO [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84a276df1e06cbad7d635e079454f90f columnFamilyName f2 2023-02-15 23:01:23,198 INFO [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] regionserver.HStore(310): Store=84a276df1e06cbad7d635e079454f90f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:23,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:23,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:23,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:23,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0812508db509f468361033bc0fee2f89, NAME => 'testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-15 23:01:23,200 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7f512703cd1cf77f16739c1668e6bf17, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:23,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0812508db509f468361033bc0fee2f89 2023-02-15 23:01:23,200 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083200"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502083200"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502083200"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502083200"}]},"ts":"1676502083200"} 2023-02-15 23:01:23,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:23,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0812508db509f468361033bc0fee2f89 2023-02-15 23:01:23,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0812508db509f468361033bc0fee2f89 2023-02-15 23:01:23,201 INFO [StoreOpener-0812508db509f468361033bc0fee2f89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0812508db509f468361033bc0fee2f89 2023-02-15 23:01:23,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:23,203 DEBUG [StoreOpener-0812508db509f468361033bc0fee2f89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f1 2023-02-15 23:01:23,203 DEBUG [StoreOpener-0812508db509f468361033bc0fee2f89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f1 2023-02-15 23:01:23,204 INFO [StoreOpener-0812508db509f468361033bc0fee2f89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0812508db509f468361033bc0fee2f89 columnFamilyName f1 2023-02-15 23:01:23,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:23,204 INFO [StoreOpener-0812508db509f468361033bc0fee2f89-1] regionserver.HStore(310): Store=0812508db509f468361033bc0fee2f89/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,204 INFO [StoreOpener-0812508db509f468361033bc0fee2f89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0812508db509f468361033bc0fee2f89 2023-02-15 23:01:23,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-15 23:01:23,205 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure 7f512703cd1cf77f16739c1668e6bf17, server=jenkins-hbase4.apache.org,42337,1676502081458 in 184 msec 2023-02-15 23:01:23,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7f512703cd1cf77f16739c1668e6bf17, ASSIGN in 349 msec 2023-02-15 23:01:23,206 DEBUG [StoreOpener-0812508db509f468361033bc0fee2f89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f2 2023-02-15 23:01:23,206 DEBUG [StoreOpener-0812508db509f468361033bc0fee2f89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f2 2023-02-15 23:01:23,206 INFO [StoreOpener-0812508db509f468361033bc0fee2f89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0812508db509f468361033bc0fee2f89 columnFamilyName f2 2023-02-15 23:01:23,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:23,207 INFO [StoreOpener-0812508db509f468361033bc0fee2f89-1] regionserver.HStore(310): Store=0812508db509f468361033bc0fee2f89/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 84a276df1e06cbad7d635e079454f90f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64246750, jitterRate=-0.04264882206916809}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:23,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 84a276df1e06cbad7d635e079454f90f: 2023-02-15 23:01:23,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89 2023-02-15 23:01:23,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f., pid=27, masterSystemTime=1676502083186 2023-02-15 23:01:23,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89 2023-02-15 23:01:23,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:23,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:23,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:23,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 20ea34416c70729c1f49ad26d44cc554, NAME => 'testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-15 23:01:23,209 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=84a276df1e06cbad7d635e079454f90f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:23,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:23,210 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083209"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502083209"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502083209"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502083209"}]},"ts":"1676502083209"} 2023-02-15 23:01:23,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:23,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:23,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:23,212 INFO [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:23,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0812508db509f468361033bc0fee2f89 2023-02-15 23:01:23,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-15 23:01:23,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure 84a276df1e06cbad7d635e079454f90f, server=jenkins-hbase4.apache.org,40177,1676502081496 in 183 msec 2023-02-15 23:01:23,214 DEBUG [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f1 2023-02-15 23:01:23,214 DEBUG [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f1 2023-02-15 23:01:23,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:23,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=84a276df1e06cbad7d635e079454f90f, ASSIGN in 357 msec 2023-02-15 23:01:23,215 INFO [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20ea34416c70729c1f49ad26d44cc554 columnFamilyName f1 2023-02-15 23:01:23,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0812508db509f468361033bc0fee2f89; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69255436, jitterRate=0.03198641538619995}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:23,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0812508db509f468361033bc0fee2f89: 2023-02-15 23:01:23,215 INFO [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] regionserver.HStore(310): Store=20ea34416c70729c1f49ad26d44cc554/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,215 INFO [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:23,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89., pid=25, masterSystemTime=1676502083170 2023-02-15 23:01:23,217 DEBUG [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f2 2023-02-15 23:01:23,217 DEBUG [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f2 2023-02-15 23:01:23,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:23,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:23,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:23,217 INFO [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20ea34416c70729c1f49ad26d44cc554 columnFamilyName f2 2023-02-15 23:01:23,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0c9883f7fe6f5e63fd6edafb3e54b69d, NAME => 'testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-15 23:01:23,217 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0812508db509f468361033bc0fee2f89, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:23,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:23,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:23,218 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083217"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502083217"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502083217"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502083217"}]},"ts":"1676502083217"} 2023-02-15 23:01:23,218 INFO [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] regionserver.HStore(310): Store=20ea34416c70729c1f49ad26d44cc554/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:23,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:23,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:23,219 INFO [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:23,220 DEBUG [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f1 2023-02-15 23:01:23,220 DEBUG [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f1 2023-02-15 23:01:23,221 INFO [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c9883f7fe6f5e63fd6edafb3e54b69d columnFamilyName f1 2023-02-15 23:01:23,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:23,221 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-15 23:01:23,221 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure 0812508db509f468361033bc0fee2f89, server=jenkins-hbase4.apache.org,42337,1676502081458 in 195 msec 2023-02-15 23:01:23,221 INFO [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] regionserver.HStore(310): Store=0c9883f7fe6f5e63fd6edafb3e54b69d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,221 INFO [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:23,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:23,229 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0812508db509f468361033bc0fee2f89, ASSIGN in 365 msec 2023-02-15 23:01:23,229 DEBUG [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f2 2023-02-15 23:01:23,229 DEBUG [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f2 2023-02-15 23:01:23,230 INFO [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c9883f7fe6f5e63fd6edafb3e54b69d columnFamilyName f2 2023-02-15 23:01:23,230 INFO [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] regionserver.HStore(310): Store=0c9883f7fe6f5e63fd6edafb3e54b69d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:23,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:23,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:23,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 20ea34416c70729c1f49ad26d44cc554; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68803185, jitterRate=0.025247350335121155}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:23,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 20ea34416c70729c1f49ad26d44cc554: 2023-02-15 23:01:23,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554., pid=28, masterSystemTime=1676502083186 2023-02-15 23:01:23,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:23,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:23,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:23,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:23,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => be65b27959e3e6148503368d367bb9c8, NAME => 'testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-15 23:01:23,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:23,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:23,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:23,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:23,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:23,236 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=20ea34416c70729c1f49ad26d44cc554, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,236 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083236"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502083236"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502083236"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502083236"}]},"ts":"1676502083236"} 2023-02-15 23:01:23,237 INFO [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:23,239 DEBUG [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/be65b27959e3e6148503368d367bb9c8/f1 2023-02-15 23:01:23,239 DEBUG [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/be65b27959e3e6148503368d367bb9c8/f1 2023-02-15 23:01:23,239 INFO [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be65b27959e3e6148503368d367bb9c8 columnFamilyName f1 2023-02-15 23:01:23,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:23,240 INFO [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] regionserver.HStore(310): Store=be65b27959e3e6148503368d367bb9c8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,240 INFO [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:23,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0c9883f7fe6f5e63fd6edafb3e54b69d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70499416, jitterRate=0.05052316188812256}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:23,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0c9883f7fe6f5e63fd6edafb3e54b69d: 2023-02-15 23:01:23,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-15 23:01:23,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure 20ea34416c70729c1f49ad26d44cc554, server=jenkins-hbase4.apache.org,40177,1676502081496 in 208 msec 2023-02-15 23:01:23,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d., pid=21, masterSystemTime=1676502083170 2023-02-15 23:01:23,242 DEBUG [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/be65b27959e3e6148503368d367bb9c8/f2 2023-02-15 23:01:23,242 DEBUG [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/be65b27959e3e6148503368d367bb9c8/f2 2023-02-15 23:01:23,243 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=20ea34416c70729c1f49ad26d44cc554, ASSIGN in 384 msec 2023-02-15 23:01:23,243 INFO [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be65b27959e3e6148503368d367bb9c8 columnFamilyName f2 2023-02-15 23:01:23,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:23,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:23,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:23,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a3ca5e20630f4094ffb524cfe766fc59, NAME => 'testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-15 23:01:23,244 INFO [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] regionserver.HStore(310): Store=be65b27959e3e6148503368d367bb9c8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,244 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=0c9883f7fe6f5e63fd6edafb3e54b69d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,244 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083244"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502083244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502083244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502083244"}]},"ts":"1676502083244"} 2023-02-15 23:01:23,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:23,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:23,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:23,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:23,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:23,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:23,247 INFO [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:23,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-15 23:01:23,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure 0c9883f7fe6f5e63fd6edafb3e54b69d, server=jenkins-hbase4.apache.org,42337,1676502081458 in 229 msec 2023-02-15 23:01:23,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:23,249 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0c9883f7fe6f5e63fd6edafb3e54b69d, ASSIGN in 392 msec 2023-02-15 23:01:23,249 DEBUG [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f1 2023-02-15 23:01:23,250 DEBUG [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f1 2023-02-15 23:01:23,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:23,250 INFO [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3ca5e20630f4094ffb524cfe766fc59 columnFamilyName f1 2023-02-15 23:01:23,251 INFO [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] regionserver.HStore(310): Store=a3ca5e20630f4094ffb524cfe766fc59/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,251 INFO [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:23,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/be65b27959e3e6148503368d367bb9c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:23,252 DEBUG [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f2 2023-02-15 23:01:23,252 DEBUG [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f2 2023-02-15 23:01:23,252 INFO [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3ca5e20630f4094ffb524cfe766fc59 columnFamilyName f2 2023-02-15 23:01:23,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened be65b27959e3e6148503368d367bb9c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63055272, jitterRate=-0.06040322780609131}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:23,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for be65b27959e3e6148503368d367bb9c8: 2023-02-15 23:01:23,253 INFO [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] regionserver.HStore(310): Store=a3ca5e20630f4094ffb524cfe766fc59/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8., pid=30, masterSystemTime=1676502083186 2023-02-15 23:01:23,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:23,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:23,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:23,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:23,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:23,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3f67bab442b50e260b213bb216916965, NAME => 'testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-15 23:01:23,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3f67bab442b50e260b213bb216916965 2023-02-15 23:01:23,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:23,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3f67bab442b50e260b213bb216916965 2023-02-15 23:01:23,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3f67bab442b50e260b213bb216916965 2023-02-15 23:01:23,257 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=be65b27959e3e6148503368d367bb9c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,257 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502083256"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502083256"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502083256"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502083256"}]},"ts":"1676502083256"} 2023-02-15 23:01:23,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:23,258 INFO [StoreOpener-3f67bab442b50e260b213bb216916965-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f67bab442b50e260b213bb216916965 2023-02-15 23:01:23,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:23,260 DEBUG [StoreOpener-3f67bab442b50e260b213bb216916965-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f1 2023-02-15 23:01:23,260 DEBUG [StoreOpener-3f67bab442b50e260b213bb216916965-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f1 2023-02-15 23:01:23,260 INFO [StoreOpener-3f67bab442b50e260b213bb216916965-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f67bab442b50e260b213bb216916965 columnFamilyName f1 2023-02-15 23:01:23,261 INFO [StoreOpener-3f67bab442b50e260b213bb216916965-1] regionserver.HStore(310): Store=3f67bab442b50e260b213bb216916965/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,261 INFO [StoreOpener-3f67bab442b50e260b213bb216916965-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f67bab442b50e260b213bb216916965 2023-02-15 23:01:23,261 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=20 2023-02-15 23:01:23,261 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=20, state=SUCCESS; OpenRegionProcedure be65b27959e3e6148503368d367bb9c8, server=jenkins-hbase4.apache.org,40177,1676502081496 in 220 msec 2023-02-15 23:01:23,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:23,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a3ca5e20630f4094ffb524cfe766fc59; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60284388, jitterRate=-0.10169261693954468}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:23,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a3ca5e20630f4094ffb524cfe766fc59: 2023-02-15 23:01:23,262 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=be65b27959e3e6148503368d367bb9c8, ASSIGN in 405 msec 2023-02-15 23:01:23,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59., pid=24, masterSystemTime=1676502083170 2023-02-15 23:01:23,263 DEBUG [StoreOpener-3f67bab442b50e260b213bb216916965-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f2 2023-02-15 23:01:23,263 DEBUG [StoreOpener-3f67bab442b50e260b213bb216916965-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f2 2023-02-15 23:01:23,264 INFO [StoreOpener-3f67bab442b50e260b213bb216916965-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f67bab442b50e260b213bb216916965 columnFamilyName f2 2023-02-15 23:01:23,264 INFO [StoreOpener-3f67bab442b50e260b213bb216916965-1] regionserver.HStore(310): Store=3f67bab442b50e260b213bb216916965/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965 2023-02-15 23:01:23,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:23,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965 2023-02-15 23:01:23,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:23,266 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a3ca5e20630f4094ffb524cfe766fc59, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:23,266 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083266"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502083266"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502083266"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502083266"}]},"ts":"1676502083266"} 2023-02-15 23:01:23,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e607e14d285a83ed1504025b564b08b5, NAME => 'testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-15 23:01:23,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:23,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:23,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:23,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:23,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:23,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3f67bab442b50e260b213bb216916965 2023-02-15 23:01:23,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=13 2023-02-15 23:01:23,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=13, state=SUCCESS; OpenRegionProcedure a3ca5e20630f4094ffb524cfe766fc59, server=jenkins-hbase4.apache.org,42337,1676502081458 in 246 msec 2023-02-15 23:01:23,272 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a3ca5e20630f4094ffb524cfe766fc59, ASSIGN in 415 msec 2023-02-15 23:01:23,276 INFO [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:23,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:23,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3f67bab442b50e260b213bb216916965; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62047100, jitterRate=-0.07542616128921509}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:23,277 DEBUG [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/e607e14d285a83ed1504025b564b08b5/f1 2023-02-15 23:01:23,277 DEBUG [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/e607e14d285a83ed1504025b564b08b5/f1 2023-02-15 23:01:23,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3f67bab442b50e260b213bb216916965: 2023-02-15 23:01:23,278 INFO [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e607e14d285a83ed1504025b564b08b5 columnFamilyName f1 2023-02-15 23:01:23,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965., pid=26, masterSystemTime=1676502083186 2023-02-15 23:01:23,278 INFO [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] regionserver.HStore(310): Store=e607e14d285a83ed1504025b564b08b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,279 INFO [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:23,280 DEBUG [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/e607e14d285a83ed1504025b564b08b5/f2 2023-02-15 23:01:23,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:23,280 DEBUG [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/e607e14d285a83ed1504025b564b08b5/f2 2023-02-15 23:01:23,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:23,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:23,281 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3f67bab442b50e260b213bb216916965, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f0410aee6a8c37d5108bfc4e72e112ff, NAME => 'testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-15 23:01:23,281 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676502082745.3f67bab442b50e260b213bb216916965.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083280"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502083280"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502083280"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502083280"}]},"ts":"1676502083280"} 2023-02-15 23:01:23,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:23,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:23,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:23,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:23,281 INFO [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e607e14d285a83ed1504025b564b08b5 columnFamilyName f2 2023-02-15 23:01:23,282 INFO [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] regionserver.HStore(310): Store=e607e14d285a83ed1504025b564b08b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,283 INFO [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:23,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:23,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:23,284 DEBUG [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f1 2023-02-15 23:01:23,284 DEBUG [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f1 2023-02-15 23:01:23,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-15 23:01:23,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure 3f67bab442b50e260b213bb216916965, server=jenkins-hbase4.apache.org,40177,1676502081496 in 255 msec 2023-02-15 23:01:23,285 INFO [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0410aee6a8c37d5108bfc4e72e112ff columnFamilyName f1 2023-02-15 23:01:23,286 INFO [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] regionserver.HStore(310): Store=f0410aee6a8c37d5108bfc4e72e112ff/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:23,286 INFO [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:23,286 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3f67bab442b50e260b213bb216916965, ASSIGN in 429 msec 2023-02-15 23:01:23,287 DEBUG [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f2 2023-02-15 23:01:23,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:23,287 DEBUG [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f2 2023-02-15 23:01:23,287 INFO [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0410aee6a8c37d5108bfc4e72e112ff columnFamilyName f2 2023-02-15 23:01:23,288 INFO [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] regionserver.HStore(310): Store=f0410aee6a8c37d5108bfc4e72e112ff/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:23,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:23,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:23,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/e607e14d285a83ed1504025b564b08b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:23,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e607e14d285a83ed1504025b564b08b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66674663, jitterRate=-0.006470099091529846}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:23,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e607e14d285a83ed1504025b564b08b5: 2023-02-15 23:01:23,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5., pid=23, masterSystemTime=1676502083170 2023-02-15 23:01:23,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:23,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:23,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:23,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:23,292 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e607e14d285a83ed1504025b564b08b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,292 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676502083292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502083292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502083292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502083292"}]},"ts":"1676502083292"} 2023-02-15 23:01:23,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:23,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f0410aee6a8c37d5108bfc4e72e112ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60528598, jitterRate=-0.09805360436439514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:23,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f0410aee6a8c37d5108bfc4e72e112ff: 2023-02-15 23:01:23,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff., pid=29, masterSystemTime=1676502083186 2023-02-15 23:01:23,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-15 23:01:23,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure e607e14d285a83ed1504025b564b08b5, server=jenkins-hbase4.apache.org,42337,1676502081458 in 275 msec 2023-02-15 23:01:23,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e607e14d285a83ed1504025b564b08b5, ASSIGN in 439 msec 2023-02-15 23:01:23,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:23,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:23,297 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f0410aee6a8c37d5108bfc4e72e112ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,297 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676502083297"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502083297"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502083297"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502083297"}]},"ts":"1676502083297"} 2023-02-15 23:01:23,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-15 23:01:23,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure f0410aee6a8c37d5108bfc4e72e112ff, server=jenkins-hbase4.apache.org,40177,1676502081496 in 267 msec 2023-02-15 23:01:23,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-15 23:01:23,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f0410aee6a8c37d5108bfc4e72e112ff, ASSIGN in 444 msec 2023-02-15 23:01:23,302 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:23,302 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502083302"}]},"ts":"1676502083302"} 2023-02-15 23:01:23,304 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-15 23:01:23,306 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:23,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 560 msec 2023-02-15 23:01:23,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:23,355 INFO [Listener at localhost/45623] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-15 23:01:23,355 DEBUG [Listener at localhost/45623] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-15 23:01:23,355 INFO [Listener at localhost/45623] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:23,360 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-15 23:01:23,360 INFO [Listener at localhost/45623] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:23,361 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-15 23:01:23,361 INFO [Listener at localhost/45623] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 23:01:23,405 DEBUG [hconnection-0x25e2c5f9-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:23,430 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39052, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:23,436 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40177] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:23,439 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42337] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:23,606 INFO [Listener at localhost/45623] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 23:01:23,606 INFO [Listener at localhost/45623] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 23:01:23,608 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 23:01:23,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676502083608 (current time:1676502083608). 2023-02-15 23:01:23,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 23:01:23,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] zookeeper.ReadOnlyZKClient(139): Connect 0x20e3976f to 127.0.0.1:61364 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:23,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@817f3c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:23,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:23,617 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33386, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:23,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20e3976f to 127.0.0.1:61364 2023-02-15 23:01:23,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:23,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 23:01:23,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 23:01:23,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 23:01:23,622 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 23:01:23,622 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676502683622 2023-02-15 23:01:23,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 23:01:23,623 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-15 23:01:23,624 DEBUG [Listener at localhost/45623] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:23,624 DEBUG [Listener at localhost/45623] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 23:01:23,624 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 23:01:23,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 23:01:23,625 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-15 23:01:23,626 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 23:01:23,626 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676502683626 2023-02-15 23:01:23,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,644 INFO [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-15 23:01:23,644 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:23,645 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-15 23:01:23,645 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-15 23:01:23,645 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,645 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,647 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:23,647 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:23,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:23,647 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:23,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:23,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:23,648 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,648 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,648 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,649 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:23,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-15 23:01:23,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,649 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 23:01:23,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-15 23:01:23,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,649 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 23:01:23,649 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-15 23:01:23,650 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:23,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,650 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-15 23:01:23,650 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-15 23:01:23,650 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40177,1676502081496' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-15 23:01:23,652 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,652 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,652 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-15 23:01:23,652 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:23,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:23,653 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-15 23:01:23,653 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-15 23:01:23,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:23,653 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,653 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:23,653 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42337,1676502081458' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-15 23:01:23,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:23,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:23,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,655 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:23,655 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,655 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40177,1676502081496' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-15 23:01:23,655 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:23,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e60d5a4[Count = 1] remaining members to acquire global barrier 2023-02-15 23:01:23,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:23,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:23,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:23,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:23,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:23,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42337,1676502081458' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-15 23:01:23,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e60d5a4[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:23,658 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-15 23:01:23,658 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,659 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,659 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,659 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-15 23:01:23,660 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:23,660 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-15 23:01:23,660 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:23,660 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. started... 2023-02-15 23:01:23,660 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:23,660 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:23,664 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0812508db509f468361033bc0fee2f89 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 23:01:23,664 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:23,664 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:23,665 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. started... 2023-02-15 23:01:23,665 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 23:01:23,665 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 23:01:23,665 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. started... 2023-02-15 23:01:23,665 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:23,665 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. started... 2023-02-15 23:01:23,665 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 7f512703cd1cf77f16739c1668e6bf17 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:23,666 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:23,666 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f0410aee6a8c37d5108bfc4e72e112ff 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:23,666 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. started... 2023-02-15 23:01:23,668 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:23,668 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] regionserver.HRegion(2744): Flushing a3ca5e20630f4094ffb524cfe766fc59 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:23,669 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 84a276df1e06cbad7d635e079454f90f 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 23:01:23,668 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 23:01:23,669 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 23:01:23,669 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. started... 2023-02-15 23:01:23,670 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 3f67bab442b50e260b213bb216916965 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:23,712 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/.tmp/f1/2450451eccaa4274873081b7bb8d2c1d 2023-02-15 23:01:23,724 DEBUG [Listener at localhost/45623] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:23,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 23:01:23,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 23:01:23,735 DEBUG [Listener at localhost/45623] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 23:01:23,741 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/.tmp/f1/b04736a42cc743728207a22e194e5b4d 2023-02-15 23:01:23,741 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/.tmp/f1/72112428c2e34f14ad52703d0113cf9e 2023-02-15 23:01:23,746 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/.tmp/f1/5a19d103646a4c72a368ce9d93546526 2023-02-15 23:01:23,747 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/.tmp/f1/e4f219fd2dfb440b9ca4c2adc2d92cde 2023-02-15 23:01:23,748 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/.tmp/f1/bf80d28c57a24e688020a9d367ae8604 2023-02-15 23:01:23,796 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/.tmp/f2/5e5455f1b7664fdab7af04fd83c28f18 2023-02-15 23:01:23,803 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/.tmp/f1/2450451eccaa4274873081b7bb8d2c1d as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f1/2450451eccaa4274873081b7bb8d2c1d 2023-02-15 23:01:23,806 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/.tmp/f2/3917048f2c0e49d2a7a941f40799cd0f 2023-02-15 23:01:23,811 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f1/2450451eccaa4274873081b7bb8d2c1d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 23:01:23,813 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/.tmp/f1/b04736a42cc743728207a22e194e5b4d as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f1/b04736a42cc743728207a22e194e5b4d 2023-02-15 23:01:23,813 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/.tmp/f2/5e5455f1b7664fdab7af04fd83c28f18 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f2/5e5455f1b7664fdab7af04fd83c28f18 2023-02-15 23:01:23,818 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f1/b04736a42cc743728207a22e194e5b4d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:23,819 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f2/5e5455f1b7664fdab7af04fd83c28f18, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 23:01:23,819 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/.tmp/f2/3917048f2c0e49d2a7a941f40799cd0f as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f2/3917048f2c0e49d2a7a941f40799cd0f 2023-02-15 23:01:23,820 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/.tmp/f2/e3a562b17adc4c5b9a6a7d4d1ddd431a 2023-02-15 23:01:23,820 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 0812508db509f468361033bc0fee2f89 in 156ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:23,820 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-15 23:01:23,821 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0812508db509f468361033bc0fee2f89: 2023-02-15 23:01:23,821 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,821 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:23,821 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f1/2450451eccaa4274873081b7bb8d2c1d] hfiles 2023-02-15 23:01:23,821 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f1/2450451eccaa4274873081b7bb8d2c1d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,821 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f2/5e5455f1b7664fdab7af04fd83c28f18] hfiles 2023-02-15 23:01:23,821 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f2/5e5455f1b7664fdab7af04fd83c28f18 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,832 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/.tmp/f2/d6001e2ce50c46e5b6e3725e753fca55 2023-02-15 23:01:23,845 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/.tmp/f2/681b7bc1dada445d81d966b4ac590a97 2023-02-15 23:01:23,847 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/.tmp/f1/72112428c2e34f14ad52703d0113cf9e as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f1/72112428c2e34f14ad52703d0113cf9e 2023-02-15 23:01:23,850 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f2/3917048f2c0e49d2a7a941f40799cd0f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:23,851 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/.tmp/f1/5a19d103646a4c72a368ce9d93546526 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f1/5a19d103646a4c72a368ce9d93546526 2023-02-15 23:01:23,851 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f0410aee6a8c37d5108bfc4e72e112ff in 185ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:23,854 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f0410aee6a8c37d5108bfc4e72e112ff: 2023-02-15 23:01:23,855 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/.tmp/f2/53cf0c6bf2d84aaab89e5d1dac427116 2023-02-15 23:01:23,855 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,855 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:23,855 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f1/b04736a42cc743728207a22e194e5b4d] hfiles 2023-02-15 23:01:23,855 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f1/b04736a42cc743728207a22e194e5b4d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,855 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f2/3917048f2c0e49d2a7a941f40799cd0f] hfiles 2023-02-15 23:01:23,855 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f2/3917048f2c0e49d2a7a941f40799cd0f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,858 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/.tmp/f1/bf80d28c57a24e688020a9d367ae8604 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f1/bf80d28c57a24e688020a9d367ae8604 2023-02-15 23:01:23,861 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f1/72112428c2e34f14ad52703d0113cf9e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:23,862 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/.tmp/f2/e3a562b17adc4c5b9a6a7d4d1ddd431a as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f2/e3a562b17adc4c5b9a6a7d4d1ddd431a 2023-02-15 23:01:23,868 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. completed. 2023-02-15 23:01:23,868 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:23,868 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:23,868 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 23:01:23,868 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. started... 2023-02-15 23:01:23,869 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f1/5a19d103646a4c72a368ce9d93546526, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:23,869 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/.tmp/f2/d6001e2ce50c46e5b6e3725e753fca55 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f2/d6001e2ce50c46e5b6e3725e753fca55 2023-02-15 23:01:23,874 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f2/d6001e2ce50c46e5b6e3725e753fca55, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:23,875 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7f512703cd1cf77f16739c1668e6bf17 in 210ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:23,875 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7f512703cd1cf77f16739c1668e6bf17: 2023-02-15 23:01:23,875 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,875 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:23,875 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f1/5a19d103646a4c72a368ce9d93546526] hfiles 2023-02-15 23:01:23,875 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f1/5a19d103646a4c72a368ce9d93546526 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,875 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f2/d6001e2ce50c46e5b6e3725e753fca55] hfiles 2023-02-15 23:01:23,875 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f2/d6001e2ce50c46e5b6e3725e753fca55 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,879 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e607e14d285a83ed1504025b564b08b5: 2023-02-15 23:01:23,879 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,879 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:23,879 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 23:01:23,879 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 23:01:23,886 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/.tmp/f1/e4f219fd2dfb440b9ca4c2adc2d92cde as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f1/e4f219fd2dfb440b9ca4c2adc2d92cde 2023-02-15 23:01:23,888 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f1/bf80d28c57a24e688020a9d367ae8604, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 23:01:23,890 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/.tmp/f2/681b7bc1dada445d81d966b4ac590a97 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f2/681b7bc1dada445d81d966b4ac590a97 2023-02-15 23:01:23,893 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f1/e4f219fd2dfb440b9ca4c2adc2d92cde, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:23,894 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/.tmp/f2/53cf0c6bf2d84aaab89e5d1dac427116 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f2/53cf0c6bf2d84aaab89e5d1dac427116 2023-02-15 23:01:23,896 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f2/e3a562b17adc4c5b9a6a7d4d1ddd431a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:23,897 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a3ca5e20630f4094ffb524cfe766fc59 in 229ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:23,897 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a3ca5e20630f4094ffb524cfe766fc59: 2023-02-15 23:01:23,897 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,897 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:23,897 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f1/72112428c2e34f14ad52703d0113cf9e] hfiles 2023-02-15 23:01:23,898 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f1/72112428c2e34f14ad52703d0113cf9e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,898 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f2/e3a562b17adc4c5b9a6a7d4d1ddd431a] hfiles 2023-02-15 23:01:23,898 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f2/e3a562b17adc4c5b9a6a7d4d1ddd431a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,900 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f2/53cf0c6bf2d84aaab89e5d1dac427116, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:23,901 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3f67bab442b50e260b213bb216916965 in 231ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:23,901 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 3f67bab442b50e260b213bb216916965: 2023-02-15 23:01:23,901 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,902 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:23,902 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f1/e4f219fd2dfb440b9ca4c2adc2d92cde] hfiles 2023-02-15 23:01:23,902 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f1/e4f219fd2dfb440b9ca4c2adc2d92cde for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,902 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f2/53cf0c6bf2d84aaab89e5d1dac427116] hfiles 2023-02-15 23:01:23,902 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f2/53cf0c6bf2d84aaab89e5d1dac427116 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,912 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. completed. 2023-02-15 23:01:23,912 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:23,912 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:23,912 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 23:01:23,912 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. started... 2023-02-15 23:01:23,913 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 20ea34416c70729c1f49ad26d44cc554 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:23,913 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f2/681b7bc1dada445d81d966b4ac590a97, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 23:01:23,914 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 84a276df1e06cbad7d635e079454f90f in 245ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:23,914 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 84a276df1e06cbad7d635e079454f90f: 2023-02-15 23:01:23,915 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,915 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:23,915 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f1/bf80d28c57a24e688020a9d367ae8604] hfiles 2023-02-15 23:01:23,915 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f1/bf80d28c57a24e688020a9d367ae8604 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,915 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f2/681b7bc1dada445d81d966b4ac590a97] hfiles 2023-02-15 23:01:23,915 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f2/681b7bc1dada445d81d966b4ac590a97 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,933 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. completed. 2023-02-15 23:01:23,933 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:23,933 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:23,933 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. started... 2023-02-15 23:01:23,933 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0c9883f7fe6f5e63fd6edafb3e54b69d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:23,934 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 23:01:23,934 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. completed. 2023-02-15 23:01:23,934 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:23,934 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 23:01:23,935 DEBUG [Listener at localhost/45623] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:23,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 23:01:23,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 23:01:23,937 DEBUG [Listener at localhost/45623] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-15 23:01:23,945 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. completed. 2023-02-15 23:01:23,945 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:23,945 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:23,945 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 23:01:23,945 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. started... 2023-02-15 23:01:23,945 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for be65b27959e3e6148503368d367bb9c8: 2023-02-15 23:01:23,945 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:23,945 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:23,946 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 23:01:23,946 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 23:01:23,956 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. completed. 2023-02-15 23:01:23,956 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:23,956 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 23:01:23,963 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/.tmp/f1/02f8eb082c80449582f8438b9cdbc180 2023-02-15 23:01:23,974 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. completed. 2023-02-15 23:01:23,974 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:23,975 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 23:01:23,983 WARN [DataStreamer for file /user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion/region-manifest.be65b27959e3e6148503368d367bb9c8] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-15 23:01:23,983 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. completed. 2023-02-15 23:01:23,983 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:23,983 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 23:01:23,988 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/.tmp/f1/13c1ea8ad5274429ae3f40faa05ea365 2023-02-15 23:01:24,006 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/.tmp/f2/6686afd8fa2f4acb98d3874cba9b087c 2023-02-15 23:01:24,012 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/.tmp/f1/02f8eb082c80449582f8438b9cdbc180 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f1/02f8eb082c80449582f8438b9cdbc180 2023-02-15 23:01:24,017 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f1/02f8eb082c80449582f8438b9cdbc180, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:24,018 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/.tmp/f2/6686afd8fa2f4acb98d3874cba9b087c as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f2/6686afd8fa2f4acb98d3874cba9b087c 2023-02-15 23:01:24,023 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/.tmp/f2/f8701f4b068940bb95f003a49f2c7c13 2023-02-15 23:01:24,024 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f2/6686afd8fa2f4acb98d3874cba9b087c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:24,025 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 20ea34416c70729c1f49ad26d44cc554 in 113ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:24,026 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 20ea34416c70729c1f49ad26d44cc554: 2023-02-15 23:01:24,026 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,026 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:24,026 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f1/02f8eb082c80449582f8438b9cdbc180] hfiles 2023-02-15 23:01:24,026 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f1/02f8eb082c80449582f8438b9cdbc180 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,026 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f2/6686afd8fa2f4acb98d3874cba9b087c] hfiles 2023-02-15 23:01:24,026 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f2/6686afd8fa2f4acb98d3874cba9b087c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,034 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/.tmp/f1/13c1ea8ad5274429ae3f40faa05ea365 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f1/13c1ea8ad5274429ae3f40faa05ea365 2023-02-15 23:01:24,038 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. completed. 2023-02-15 23:01:24,038 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:24,038 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 23:01:24,038 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 23:01:24,038 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,039 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-15 23:01:24,039 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,40177,1676502081496' in zk 2023-02-15 23:01:24,041 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,041 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-15 23:01:24,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:24,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:24,041 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:24,042 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-15 23:01:24,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:24,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:24,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:24,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,046 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f1/13c1ea8ad5274429ae3f40faa05ea365, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,40177,1676502081496': 2023-02-15 23:01:24,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40177,1676502081496' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 23:01:24,047 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/.tmp/f2/f8701f4b068940bb95f003a49f2c7c13 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f2/f8701f4b068940bb95f003a49f2c7c13 2023-02-15 23:01:24,053 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f2/f8701f4b068940bb95f003a49f2c7c13, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:24,054 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0c9883f7fe6f5e63fd6edafb3e54b69d in 121ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:24,054 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0c9883f7fe6f5e63fd6edafb3e54b69d: 2023-02-15 23:01:24,054 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,054 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:24,054 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f1/13c1ea8ad5274429ae3f40faa05ea365] hfiles 2023-02-15 23:01:24,054 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f1/13c1ea8ad5274429ae3f40faa05ea365 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,054 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f2/f8701f4b068940bb95f003a49f2c7c13] hfiles 2023-02-15 23:01:24,054 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f2/f8701f4b068940bb95f003a49f2c7c13 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,062 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. completed. 2023-02-15 23:01:24,062 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:24,062 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 23:01:24,062 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 23:01:24,062 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,062 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-15 23:01:24,062 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,42337,1676502081458' in zk 2023-02-15 23:01:24,064 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,064 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-15 23:01:24,064 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:24,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:24,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:24,064 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-15 23:01:24,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:24,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:24,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:24,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,42337,1676502081458': 2023-02-15 23:01:24,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42337,1676502081458' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 23:01:24,069 INFO [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-15 23:01:24,069 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:24,069 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:24,069 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,069 INFO [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 23:01:24,070 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,070 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:24,071 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:24,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,071 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:24,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,071 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:24,071 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:24,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:24,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:24,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:24,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:24,072 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:24,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,074 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,074 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:24,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,081 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,081 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,081 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:24,081 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:24,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:24,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:24,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:24,081 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,082 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:24,082 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,082 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:24,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:24,082 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,082 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,082 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:24,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:24,082 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:24,083 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:24,083 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:24,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,149 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-15 23:01:24,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,150 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:24,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676502083623Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676502084082 (+459 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676502084082Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676502084093 (+11 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676502084106 (+13 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676502084149 (+43 ms) 2023-02-15 23:01:24,152 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 23:01:24,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 529 msec 2023-02-15 23:01:24,238 DEBUG [Listener at localhost/45623] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:24,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 23:01:24,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 23:01:24,240 INFO [Listener at localhost/45623] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 23:01:24,246 INFO [Listener at localhost/45623] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 23:01:24,254 INFO [Listener at localhost/45623] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 23:01:24,304 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42337] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:24,304 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40177] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:24,576 INFO [AsyncFSWAL-0-hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43-prefix:jenkins-hbase4.apache.org,40177,1676502081496] wal.AbstractFSWAL(1045): Slow sync cost: 244 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:37571,DS-9ce8449b-c2cc-413e-b41c-5b9435a61c53,DISK], DatanodeInfoWithStorage[127.0.0.1:34373,DS-28c3a7bc-d8b1-4143-9fc9-3a0870be8193,DISK]] 2023-02-15 23:01:24,643 INFO [Listener at localhost/45623] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 23:01:24,650 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 23:01:24,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-15 23:01:24,654 INFO [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-15 23:01:24,654 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:24,655 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-15 23:01:24,655 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-15 23:01:24,656 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:24,656 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:24,658 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:24,658 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:24,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:24,658 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:24,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:24,658 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,658 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:24,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:24,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:24,659 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:24,659 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:24,659 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 23:01:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:24,660 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 23:01:24,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 23:01:24,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 23:01:24,662 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 23:01:24,662 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:24,665 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 23:01:24,665 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 23:01:24,665 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:24,666 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 23:01:24,666 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:24,666 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. started... 2023-02-15 23:01:24,666 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:24,666 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. started... 2023-02-15 23:01:24,666 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0812508db509f468361033bc0fee2f89 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 23:01:24,666 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 7f512703cd1cf77f16739c1668e6bf17 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:24,668 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:24,668 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. started... 2023-02-15 23:01:24,668 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:24,668 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. started... 2023-02-15 23:01:24,668 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f0410aee6a8c37d5108bfc4e72e112ff 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:24,669 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 84a276df1e06cbad7d635e079454f90f 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 23:01:24,672 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 23:01:24,672 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 23:01:24,672 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:24,672 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. started... 2023-02-15 23:01:24,672 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3f67bab442b50e260b213bb216916965 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:24,674 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 23:01:24,675 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:24,675 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 23:01:24,675 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. started... 2023-02-15 23:01:24,675 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a3ca5e20630f4094ffb524cfe766fc59 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:24,712 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/.tmp/f1/2de7d2c95bfa49b3a07f23777a186b17 2023-02-15 23:01:24,733 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/.tmp/f1/7f0dbb8f1d06496eb51aa3ae88eb467c 2023-02-15 23:01:24,745 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/.tmp/f1/716eb00c456044bfa0131027189e54c2 2023-02-15 23:01:24,745 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/.tmp/f1/8b8466bbb3fd4bcb9345cb0e818d1eb8 2023-02-15 23:01:24,749 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/.tmp/f1/841e3ee61e4e43f98492b4b2357858cb 2023-02-15 23:01:24,764 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/.tmp/f2/d03d8ab39e0c474f911e89ee4ec5fa7e 2023-02-15 23:01:24,770 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/.tmp/f2/cd965fbabbc5423e9b1657b99532b24c 2023-02-15 23:01:24,773 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/.tmp/f1/7f0dbb8f1d06496eb51aa3ae88eb467c as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f1/7f0dbb8f1d06496eb51aa3ae88eb467c 2023-02-15 23:01:24,776 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/.tmp/f2/673b56460a044374a37b43418a076cd5 2023-02-15 23:01:24,777 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/.tmp/f2/b7023a0619ed47419650be7b7a158f62 2023-02-15 23:01:24,778 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/.tmp/f1/716eb00c456044bfa0131027189e54c2 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f1/716eb00c456044bfa0131027189e54c2 2023-02-15 23:01:24,779 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f1/7f0dbb8f1d06496eb51aa3ae88eb467c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:24,781 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/.tmp/f2/d03d8ab39e0c474f911e89ee4ec5fa7e as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f2/d03d8ab39e0c474f911e89ee4ec5fa7e 2023-02-15 23:01:24,784 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/.tmp/f2/682561d60fcb417a9bb368511f9851a4 2023-02-15 23:01:24,785 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/.tmp/f1/8b8466bbb3fd4bcb9345cb0e818d1eb8 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f1/8b8466bbb3fd4bcb9345cb0e818d1eb8 2023-02-15 23:01:24,785 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f1/716eb00c456044bfa0131027189e54c2, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 23:01:24,786 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/.tmp/f1/2de7d2c95bfa49b3a07f23777a186b17 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f1/2de7d2c95bfa49b3a07f23777a186b17 2023-02-15 23:01:24,787 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/.tmp/f2/cd965fbabbc5423e9b1657b99532b24c as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f2/cd965fbabbc5423e9b1657b99532b24c 2023-02-15 23:01:24,789 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f2/d03d8ab39e0c474f911e89ee4ec5fa7e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:24,791 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/.tmp/f1/841e3ee61e4e43f98492b4b2357858cb as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f1/841e3ee61e4e43f98492b4b2357858cb 2023-02-15 23:01:24,792 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f0410aee6a8c37d5108bfc4e72e112ff in 124ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:24,792 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f1/8b8466bbb3fd4bcb9345cb0e818d1eb8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:24,793 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f0410aee6a8c37d5108bfc4e72e112ff: 2023-02-15 23:01:24,793 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:24,793 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:24,793 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 23:01:24,793 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f1/2de7d2c95bfa49b3a07f23777a186b17, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 23:01:24,793 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. started... 2023-02-15 23:01:24,793 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 20ea34416c70729c1f49ad26d44cc554 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:24,794 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f2/cd965fbabbc5423e9b1657b99532b24c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 23:01:24,794 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/.tmp/f2/b7023a0619ed47419650be7b7a158f62 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f2/b7023a0619ed47419650be7b7a158f62 2023-02-15 23:01:24,797 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/.tmp/f2/673b56460a044374a37b43418a076cd5 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f2/673b56460a044374a37b43418a076cd5 2023-02-15 23:01:24,798 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 84a276df1e06cbad7d635e079454f90f in 130ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:24,798 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 84a276df1e06cbad7d635e079454f90f: 2023-02-15 23:01:24,798 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:24,798 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:24,798 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 23:01:24,798 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. started... 2023-02-15 23:01:24,798 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for be65b27959e3e6148503368d367bb9c8: 2023-02-15 23:01:24,798 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:24,798 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 23:01:24,803 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f1/841e3ee61e4e43f98492b4b2357858cb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:24,804 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/.tmp/f2/682561d60fcb417a9bb368511f9851a4 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f2/682561d60fcb417a9bb368511f9851a4 2023-02-15 23:01:24,806 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f2/b7023a0619ed47419650be7b7a158f62, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:24,807 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a3ca5e20630f4094ffb524cfe766fc59 in 132ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:24,807 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a3ca5e20630f4094ffb524cfe766fc59: 2023-02-15 23:01:24,807 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:24,808 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:24,808 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 23:01:24,808 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. started... 2023-02-15 23:01:24,808 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e607e14d285a83ed1504025b564b08b5: 2023-02-15 23:01:24,808 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:24,808 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:24,808 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. started... 2023-02-15 23:01:24,808 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 23:01:24,808 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 0c9883f7fe6f5e63fd6edafb3e54b69d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:24,809 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f2/673b56460a044374a37b43418a076cd5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 23:01:24,809 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 0812508db509f468361033bc0fee2f89 in 143ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:24,810 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0812508db509f468361033bc0fee2f89: 2023-02-15 23:01:24,810 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:24,810 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 23:01:24,810 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f2/682561d60fcb417a9bb368511f9851a4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:24,811 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7f512703cd1cf77f16739c1668e6bf17 in 145ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:24,811 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7f512703cd1cf77f16739c1668e6bf17: 2023-02-15 23:01:24,811 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:24,811 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 23:01:24,824 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/.tmp/f1/193e84690d264261bdca2583612e9c06 2023-02-15 23:01:24,832 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/.tmp/f1/2c726fe174194ccea7aa7406bff61ec3 2023-02-15 23:01:24,842 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/.tmp/f2/9466ecc6baf84247a287c37a580b47d6 2023-02-15 23:01:24,847 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/.tmp/f1/193e84690d264261bdca2583612e9c06 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f1/193e84690d264261bdca2583612e9c06 2023-02-15 23:01:24,848 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/.tmp/f2/325ff5c3657d4129a934d8028f756996 2023-02-15 23:01:24,853 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f1/193e84690d264261bdca2583612e9c06, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:24,854 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/.tmp/f2/9466ecc6baf84247a287c37a580b47d6 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f2/9466ecc6baf84247a287c37a580b47d6 2023-02-15 23:01:24,854 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/.tmp/f1/2c726fe174194ccea7aa7406bff61ec3 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f1/2c726fe174194ccea7aa7406bff61ec3 2023-02-15 23:01:24,859 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f1/2c726fe174194ccea7aa7406bff61ec3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:24,859 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f2/9466ecc6baf84247a287c37a580b47d6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:24,860 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/.tmp/f2/325ff5c3657d4129a934d8028f756996 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f2/325ff5c3657d4129a934d8028f756996 2023-02-15 23:01:24,860 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 20ea34416c70729c1f49ad26d44cc554 in 67ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:24,861 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 20ea34416c70729c1f49ad26d44cc554: 2023-02-15 23:01:24,861 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:24,861 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 23:01:24,868 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f2/325ff5c3657d4129a934d8028f756996, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:24,869 INFO [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0c9883f7fe6f5e63fd6edafb3e54b69d in 61ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:24,869 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0c9883f7fe6f5e63fd6edafb3e54b69d: 2023-02-15 23:01:24,870 DEBUG [rs(jenkins-hbase4.apache.org,42337,1676502081458)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:24,870 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 23:01:24,870 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 23:01:24,870 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,870 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 23:01:24,870 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42337,1676502081458' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 23:01:24,872 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:24,872 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:24,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:24,872 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:24,872 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:24,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:24,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:24,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:24,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:24,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42337,1676502081458' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 23:01:24,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a5f5cb0[Count = 1] remaining members to acquire global barrier 2023-02-15 23:01:25,135 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/.tmp/f1/18a80cdb0add4c828ccf9c16b139f3b0 2023-02-15 23:01:25,149 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/.tmp/f2/44b60c03c2df491fa90ecf336003feb4 2023-02-15 23:01:25,155 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/.tmp/f1/18a80cdb0add4c828ccf9c16b139f3b0 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f1/18a80cdb0add4c828ccf9c16b139f3b0 2023-02-15 23:01:25,159 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f1/18a80cdb0add4c828ccf9c16b139f3b0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:25,160 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/.tmp/f2/44b60c03c2df491fa90ecf336003feb4 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f2/44b60c03c2df491fa90ecf336003feb4 2023-02-15 23:01:25,164 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f2/44b60c03c2df491fa90ecf336003feb4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:25,165 INFO [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3f67bab442b50e260b213bb216916965 in 493ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:25,165 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3f67bab442b50e260b213bb216916965: 2023-02-15 23:01:25,165 DEBUG [rs(jenkins-hbase4.apache.org,40177,1676502081496)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:25,165 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 23:01:25,165 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 23:01:25,165 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,165 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 23:01:25,166 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40177,1676502081496' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 23:01:25,167 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,167 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:25,168 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:25,168 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:25,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40177,1676502081496' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 23:01:25,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a5f5cb0[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:25,169 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-15 23:01:25,169 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:25,172 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:25,172 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:25,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:25,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:25,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:25,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:25,172 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 23:01:25,172 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 23:01:25,172 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 23:01:25,172 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40177,1676502081496' in zk 2023-02-15 23:01:25,172 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 23:01:25,172 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42337,1676502081458' in zk 2023-02-15 23:01:25,172 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,173 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,173 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:25,173 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 23:01:25,173 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,173 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:25,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,174 DEBUG [member: 'jenkins-hbase4.apache.org,40177,1676502081496' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 23:01:25,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:25,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:25,175 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 23:01:25,175 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,175 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:25,175 DEBUG [member: 'jenkins-hbase4.apache.org,42337,1676502081458' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 23:01:25,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:25,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:25,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:25,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:25,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:25,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,40177,1676502081496': 2023-02-15 23:01:25,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40177,1676502081496' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-15 23:01:25,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:25,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:25,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:25,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:25,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:25,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:25,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:25,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,42337,1676502081458': 2023-02-15 23:01:25,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42337,1676502081458' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-15 23:01:25,181 INFO [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-15 23:01:25,181 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:25,181 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:25,181 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-15 23:01:25,181 INFO [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 23:01:25,182 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:25,182 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:25,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:25,182 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:25,182 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:25,183 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:25,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:25,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:25,183 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:25,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:25,184 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:25,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:25,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:25,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:25,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,185 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:25,186 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:25,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,190 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,190 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:25,190 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:25,190 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,190 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:25,190 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:25,190 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-15 23:01:25,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:25,190 DEBUG [(jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:25,190 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:25,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:25,191 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:25,190 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 23:01:25,190 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:25,191 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:25,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:25,191 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,191 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:25,191 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:25,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:25,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:25,192 DEBUG [Listener at localhost/45623] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:25,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:25,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:25,192 DEBUG [Listener at localhost/45623] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 23:01:25,292 DEBUG [Listener at localhost/45623] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 23:01:25,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35535] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 23:01:25,294 INFO [Listener at localhost/45623] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 23:01:25,294 DEBUG [Listener at localhost/45623] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57997cd3 to 127.0.0.1:61364 2023-02-15 23:01:25,294 DEBUG [Listener at localhost/45623] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:25,294 DEBUG [Listener at localhost/45623] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 23:01:25,295 DEBUG [Listener at localhost/45623] util.JVMClusterUtil(257): Found active master hash=1570671435, stopped=false 2023-02-15 23:01:25,295 INFO [Listener at localhost/45623] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35535,1676502081395 2023-02-15 23:01:25,296 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:25,296 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:25,297 INFO [Listener at localhost/45623] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 23:01:25,296 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:25,297 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:25,299 DEBUG [Listener at localhost/45623] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b4ddd38 to 127.0.0.1:61364 2023-02-15 23:01:25,299 DEBUG [Listener at localhost/45623] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:25,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:25,299 INFO [Listener at localhost/45623] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42337,1676502081458' ***** 2023-02-15 23:01:25,299 INFO [Listener at localhost/45623] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:25,299 INFO [Listener at localhost/45623] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40177,1676502081496' ***** 2023-02-15 23:01:25,299 INFO [Listener at localhost/45623] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:25,299 INFO [RS:0;jenkins-hbase4:42337] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:25,299 INFO [RS:1;jenkins-hbase4:40177] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:25,299 INFO [RS:0;jenkins-hbase4:42337] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:25,299 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:25,300 INFO [RS:0;jenkins-hbase4:42337] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:25,300 INFO [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(3304): Received CLOSE for 0812508db509f468361033bc0fee2f89 2023-02-15 23:01:25,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:25,300 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:25,299 INFO [RS:1;jenkins-hbase4:40177] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:25,301 INFO [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(3304): Received CLOSE for 7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:25,301 INFO [RS:1;jenkins-hbase4:40177] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:25,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0812508db509f468361033bc0fee2f89, disabling compactions & flushes 2023-02-15 23:01:25,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:25,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:25,301 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(3304): Received CLOSE for f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:25,301 INFO [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(3304): Received CLOSE for a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:25,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:25,302 INFO [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(3304): Received CLOSE for e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:25,302 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(3304): Received CLOSE for 1b57104861a95645904bd5b9e8b07eb1 2023-02-15 23:01:25,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f0410aee6a8c37d5108bfc4e72e112ff, disabling compactions & flushes 2023-02-15 23:01:25,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. after waiting 0 ms 2023-02-15 23:01:25,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:25,302 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(3304): Received CLOSE for 84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:25,302 INFO [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(3304): Received CLOSE for 0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:25,302 INFO [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,302 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(3304): Received CLOSE for 3f67bab442b50e260b213bb216916965 2023-02-15 23:01:25,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:25,302 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(3304): Received CLOSE for 20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:25,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:25,302 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(3304): Received CLOSE for be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:25,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. after waiting 0 ms 2023-02-15 23:01:25,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:25,302 DEBUG [RS:0;jenkins-hbase4:42337] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00f1f754 to 127.0.0.1:61364 2023-02-15 23:01:25,302 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,302 DEBUG [RS:0;jenkins-hbase4:42337] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:25,302 DEBUG [RS:1;jenkins-hbase4:40177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65c04ded to 127.0.0.1:61364 2023-02-15 23:01:25,303 INFO [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-15 23:01:25,303 DEBUG [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(1479): Online Regions={0812508db509f468361033bc0fee2f89=testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89., 7f512703cd1cf77f16739c1668e6bf17=testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17., a3ca5e20630f4094ffb524cfe766fc59=testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59., e607e14d285a83ed1504025b564b08b5=testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5., 0c9883f7fe6f5e63fd6edafb3e54b69d=testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d.} 2023-02-15 23:01:25,303 DEBUG [RS:1;jenkins-hbase4:40177] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:25,303 DEBUG [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(1505): Waiting on 0812508db509f468361033bc0fee2f89, 0c9883f7fe6f5e63fd6edafb3e54b69d, 7f512703cd1cf77f16739c1668e6bf17, a3ca5e20630f4094ffb524cfe766fc59, e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:25,303 INFO [RS:1;jenkins-hbase4:40177] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:25,305 INFO [RS:1;jenkins-hbase4:40177] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:25,305 INFO [RS:1;jenkins-hbase4:40177] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:25,306 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 23:01:25,307 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-15 23:01:25,307 DEBUG [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(1479): Online Regions={f0410aee6a8c37d5108bfc4e72e112ff=testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff., 1b57104861a95645904bd5b9e8b07eb1=hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1., 1588230740=hbase:meta,,1.1588230740, 84a276df1e06cbad7d635e079454f90f=testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f., 3f67bab442b50e260b213bb216916965=testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965., 20ea34416c70729c1f49ad26d44cc554=testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554., be65b27959e3e6148503368d367bb9c8=testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8.} 2023-02-15 23:01:25,307 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:25,308 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:25,308 DEBUG [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(1505): Waiting on 1588230740, 1b57104861a95645904bd5b9e8b07eb1, 20ea34416c70729c1f49ad26d44cc554, 3f67bab442b50e260b213bb216916965, 84a276df1e06cbad7d635e079454f90f, be65b27959e3e6148503368d367bb9c8, f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:25,308 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:25,310 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:25,310 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:25,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-15 23:01:25,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:25,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:25,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:25,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:25,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0812508db509f468361033bc0fee2f89: 2023-02-15 23:01:25,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f0410aee6a8c37d5108bfc4e72e112ff: 2023-02-15 23:01:25,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:25,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:25,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7f512703cd1cf77f16739c1668e6bf17, disabling compactions & flushes 2023-02-15 23:01:25,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1b57104861a95645904bd5b9e8b07eb1, disabling compactions & flushes 2023-02-15 23:01:25,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. 2023-02-15 23:01:25,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:25,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. 2023-02-15 23:01:25,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:25,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. after waiting 0 ms 2023-02-15 23:01:25,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. 2023-02-15 23:01:25,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. after waiting 0 ms 2023-02-15 23:01:25,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1b57104861a95645904bd5b9e8b07eb1 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 23:01:25,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:25,328 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/.tmp/info/cbdbf6e946724b77b20753f621a74afc 2023-02-15 23:01:25,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:25,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:25,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7f512703cd1cf77f16739c1668e6bf17: 2023-02-15 23:01:25,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:25,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a3ca5e20630f4094ffb524cfe766fc59, disabling compactions & flushes 2023-02-15 23:01:25,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:25,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:25,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. after waiting 0 ms 2023-02-15 23:01:25,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:25,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/namespace/1b57104861a95645904bd5b9e8b07eb1/.tmp/info/9876db9ed6b542318c46f487dc40e7ab 2023-02-15 23:01:25,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/namespace/1b57104861a95645904bd5b9e8b07eb1/.tmp/info/9876db9ed6b542318c46f487dc40e7ab as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/namespace/1b57104861a95645904bd5b9e8b07eb1/info/9876db9ed6b542318c46f487dc40e7ab 2023-02-15 23:01:25,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:25,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:25,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a3ca5e20630f4094ffb524cfe766fc59: 2023-02-15 23:01:25,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:25,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e607e14d285a83ed1504025b564b08b5, disabling compactions & flushes 2023-02-15 23:01:25,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:25,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:25,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. after waiting 0 ms 2023-02-15 23:01:25,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:25,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/namespace/1b57104861a95645904bd5b9e8b07eb1/info/9876db9ed6b542318c46f487dc40e7ab, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 23:01:25,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1b57104861a95645904bd5b9e8b07eb1 in 44ms, sequenceid=6, compaction requested=false 2023-02-15 23:01:25,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-15 23:01:25,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/.tmp/table/6580618ccf434d6cab24e24ef4e1e858 2023-02-15 23:01:25,367 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/.tmp/info/cbdbf6e946724b77b20753f621a74afc as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/info/cbdbf6e946724b77b20753f621a74afc 2023-02-15 23:01:25,372 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/info/cbdbf6e946724b77b20753f621a74afc, entries=110, sequenceid=32, filesize=18.7 K 2023-02-15 23:01:25,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/.tmp/table/6580618ccf434d6cab24e24ef4e1e858 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/table/6580618ccf434d6cab24e24ef4e1e858 2023-02-15 23:01:25,375 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:25,375 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:25,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/e607e14d285a83ed1504025b564b08b5/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 23:01:25,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:25,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e607e14d285a83ed1504025b564b08b5: 2023-02-15 23:01:25,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:25,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0c9883f7fe6f5e63fd6edafb3e54b69d, disabling compactions & flushes 2023-02-15 23:01:25,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:25,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:25,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. after waiting 0 ms 2023-02-15 23:01:25,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:25,379 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/table/6580618ccf434d6cab24e24ef4e1e858, entries=4, sequenceid=32, filesize=4.8 K 2023-02-15 23:01:25,380 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 69ms, sequenceid=32, compaction requested=false 2023-02-15 23:01:25,380 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-15 23:01:25,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/namespace/1b57104861a95645904bd5b9e8b07eb1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 23:01:25,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:25,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. 2023-02-15 23:01:25,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1b57104861a95645904bd5b9e8b07eb1: 2023-02-15 23:01:25,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676502082160.1b57104861a95645904bd5b9e8b07eb1. 2023-02-15 23:01:25,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:25,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 84a276df1e06cbad7d635e079454f90f, disabling compactions & flushes 2023-02-15 23:01:25,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0c9883f7fe6f5e63fd6edafb3e54b69d: 2023-02-15 23:01:25,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:25,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:25,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:25,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. after waiting 0 ms 2023-02-15 23:01:25,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:25,397 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-15 23:01:25,398 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 23:01:25,404 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:25,404 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:25,404 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:25,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:25,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:25,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 84a276df1e06cbad7d635e079454f90f: 2023-02-15 23:01:25,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:25,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3f67bab442b50e260b213bb216916965, disabling compactions & flushes 2023-02-15 23:01:25,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:25,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:25,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. after waiting 0 ms 2023-02-15 23:01:25,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:25,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:25,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:25,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3f67bab442b50e260b213bb216916965: 2023-02-15 23:01:25,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:25,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 20ea34416c70729c1f49ad26d44cc554, disabling compactions & flushes 2023-02-15 23:01:25,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:25,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:25,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. after waiting 0 ms 2023-02-15 23:01:25,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:25,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:25,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:25,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 20ea34416c70729c1f49ad26d44cc554: 2023-02-15 23:01:25,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:25,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing be65b27959e3e6148503368d367bb9c8, disabling compactions & flushes 2023-02-15 23:01:25,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:25,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:25,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. after waiting 0 ms 2023-02-15 23:01:25,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:25,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/data/default/testWithMapReduce/be65b27959e3e6148503368d367bb9c8/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 23:01:25,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:25,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for be65b27959e3e6148503368d367bb9c8: 2023-02-15 23:01:25,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:25,504 INFO [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42337,1676502081458; all regions closed. 2023-02-15 23:01:25,509 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40177,1676502081496; all regions closed. 2023-02-15 23:01:25,511 DEBUG [RS:0;jenkins-hbase4:42337] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/oldWALs 2023-02-15 23:01:25,511 INFO [RS:0;jenkins-hbase4:42337] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42337%2C1676502081458:(num 1676502082844) 2023-02-15 23:01:25,511 DEBUG [RS:0;jenkins-hbase4:42337] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:25,511 INFO [RS:0;jenkins-hbase4:42337] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:25,512 INFO [RS:0;jenkins-hbase4:42337] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:25,512 INFO [RS:0;jenkins-hbase4:42337] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:25,512 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:25,512 INFO [RS:0;jenkins-hbase4:42337] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:25,512 INFO [RS:0;jenkins-hbase4:42337] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:25,513 INFO [RS:0;jenkins-hbase4:42337] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42337 2023-02-15 23:01:25,517 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,517 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:25,517 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42337,1676502081458 2023-02-15 23:01:25,517 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:25,517 ERROR [Listener at localhost/45623-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a4d7f86 rejected from java.util.concurrent.ThreadPoolExecutor@4e72e217[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:25,517 DEBUG [RS:1;jenkins-hbase4:40177] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/oldWALs 2023-02-15 23:01:25,517 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:25,517 INFO [RS:1;jenkins-hbase4:40177] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40177%2C1676502081496.meta:.meta(num 1676502082096) 2023-02-15 23:01:25,517 ERROR [Listener at localhost/45623-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ba11405 rejected from java.util.concurrent.ThreadPoolExecutor@4e72e217[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:25,519 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42337,1676502081458] 2023-02-15 23:01:25,519 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42337,1676502081458; numProcessing=1 2023-02-15 23:01:25,521 DEBUG [RS:1;jenkins-hbase4:40177] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/oldWALs 2023-02-15 23:01:25,522 INFO [RS:1;jenkins-hbase4:40177] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40177%2C1676502081496:(num 1676502082534) 2023-02-15 23:01:25,522 DEBUG [RS:1;jenkins-hbase4:40177] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:25,522 INFO [RS:1;jenkins-hbase4:40177] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:25,522 INFO [RS:1;jenkins-hbase4:40177] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:25,522 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:25,523 INFO [RS:1;jenkins-hbase4:40177] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40177 2023-02-15 23:01:25,619 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:25,619 INFO [RS:0;jenkins-hbase4:42337] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42337,1676502081458; zookeeper connection closed. 2023-02-15 23:01:25,619 ERROR [Listener at localhost/45623-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@638ac6a3 rejected from java.util.concurrent.ThreadPoolExecutor@4e72e217[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:25,620 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:42337-0x1005a3789130001, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:25,620 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@37eb8cad] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@37eb8cad 2023-02-15 23:01:25,620 ERROR [Listener at localhost/45623-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@78cdbaa0 rejected from java.util.concurrent.ThreadPoolExecutor@4e72e217[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:25,621 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42337,1676502081458 already deleted, retry=false 2023-02-15 23:01:25,621 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42337,1676502081458 expired; onlineServers=1 2023-02-15 23:01:25,623 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40177,1676502081496 2023-02-15 23:01:25,623 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:25,623 ERROR [Listener at localhost/45623-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b9684ef rejected from java.util.concurrent.ThreadPoolExecutor@5fa90b45[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:25,624 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40177,1676502081496] 2023-02-15 23:01:25,624 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40177,1676502081496; numProcessing=2 2023-02-15 23:01:25,625 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40177,1676502081496 already deleted, retry=false 2023-02-15 23:01:25,625 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40177,1676502081496 expired; onlineServers=0 2023-02-15 23:01:25,625 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35535,1676502081395' ***** 2023-02-15 23:01:25,625 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 23:01:25,626 DEBUG [M:0;jenkins-hbase4:35535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ca38170, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:25,626 INFO [M:0;jenkins-hbase4:35535] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35535,1676502081395 2023-02-15 23:01:25,626 INFO [M:0;jenkins-hbase4:35535] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35535,1676502081395; all regions closed. 2023-02-15 23:01:25,626 DEBUG [M:0;jenkins-hbase4:35535] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:25,626 DEBUG [M:0;jenkins-hbase4:35535] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 23:01:25,626 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 23:01:25,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502081703] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502081703,5,FailOnTimeoutGroup] 2023-02-15 23:01:25,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502081703] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502081703,5,FailOnTimeoutGroup] 2023-02-15 23:01:25,626 DEBUG [M:0;jenkins-hbase4:35535] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 23:01:25,627 INFO [M:0;jenkins-hbase4:35535] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 23:01:25,627 INFO [M:0;jenkins-hbase4:35535] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 23:01:25,627 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:25,628 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:25,628 INFO [M:0;jenkins-hbase4:35535] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 23:01:25,628 DEBUG [M:0;jenkins-hbase4:35535] master.HMaster(1512): Stopping service threads 2023-02-15 23:01:25,628 INFO [M:0;jenkins-hbase4:35535] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 23:01:25,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:25,628 ERROR [M:0;jenkins-hbase4:35535] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 23:01:25,628 INFO [M:0;jenkins-hbase4:35535] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 23:01:25,629 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 23:01:25,629 DEBUG [M:0;jenkins-hbase4:35535] zookeeper.ZKUtil(398): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 23:01:25,629 WARN [M:0;jenkins-hbase4:35535] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 23:01:25,629 INFO [M:0;jenkins-hbase4:35535] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 23:01:25,630 INFO [M:0;jenkins-hbase4:35535] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 23:01:25,630 DEBUG [M:0;jenkins-hbase4:35535] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:25,630 INFO [M:0;jenkins-hbase4:35535] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:25,630 DEBUG [M:0;jenkins-hbase4:35535] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:25,630 DEBUG [M:0;jenkins-hbase4:35535] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:25,630 DEBUG [M:0;jenkins-hbase4:35535] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:25,630 INFO [M:0;jenkins-hbase4:35535] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.96 KB heapSize=120.63 KB 2023-02-15 23:01:25,642 INFO [M:0;jenkins-hbase4:35535] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.96 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1c4f8d5a82b14d3a9d5d66726567e6c9 2023-02-15 23:01:25,647 DEBUG [M:0;jenkins-hbase4:35535] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1c4f8d5a82b14d3a9d5d66726567e6c9 as hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1c4f8d5a82b14d3a9d5d66726567e6c9 2023-02-15 23:01:25,651 INFO [M:0;jenkins-hbase4:35535] regionserver.HStore(1080): Added hdfs://localhost:44419/user/jenkins/test-data/6496ab8c-f78e-8f6e-c2ac-ec01e3c01c43/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1c4f8d5a82b14d3a9d5d66726567e6c9, entries=31, sequenceid=218, filesize=9.0 K 2023-02-15 23:01:25,652 INFO [M:0;jenkins-hbase4:35535] regionserver.HRegion(2947): Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=218, compaction requested=false 2023-02-15 23:01:25,652 INFO [M:0;jenkins-hbase4:35535] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:25,652 DEBUG [M:0;jenkins-hbase4:35535] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:25,657 INFO [M:0;jenkins-hbase4:35535] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 23:01:25,657 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:25,657 INFO [M:0;jenkins-hbase4:35535] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35535 2023-02-15 23:01:25,662 DEBUG [M:0;jenkins-hbase4:35535] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35535,1676502081395 already deleted, retry=false 2023-02-15 23:01:25,724 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:25,724 INFO [RS:1;jenkins-hbase4:40177] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40177,1676502081496; zookeeper connection closed. 2023-02-15 23:01:25,724 ERROR [Listener at localhost/45623-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@44a5157c rejected from java.util.concurrent.ThreadPoolExecutor@5fa90b45[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:25,724 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): regionserver:40177-0x1005a3789130002, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:25,724 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@19acaffe] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@19acaffe 2023-02-15 23:01:25,724 ERROR [Listener at localhost/45623-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c1f95e2 rejected from java.util.concurrent.ThreadPoolExecutor@5fa90b45[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:25,724 INFO [Listener at localhost/45623] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 23:01:25,824 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:25,824 INFO [M:0;jenkins-hbase4:35535] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35535,1676502081395; zookeeper connection closed. 2023-02-15 23:01:25,824 ERROR [Listener at localhost/45623-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@c6f48de rejected from java.util.concurrent.ThreadPoolExecutor@850cd8b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:25,825 DEBUG [Listener at localhost/45623-EventThread] zookeeper.ZKWatcher(600): master:35535-0x1005a3789130000, quorum=127.0.0.1:61364, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:25,825 ERROR [Listener at localhost/45623-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a0aaaca rejected from java.util.concurrent.ThreadPoolExecutor@850cd8b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:25,911 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/hadoop-1921293529868927103.jar 2023-02-15 23:01:25,916 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676502083608 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:25,916 DEBUG [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce 2023-02-15 23:01:25,916 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(239): region to add: f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:25,916 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(239): region to add: 0812508db509f468361033bc0fee2f89 2023-02-15 23:01:25,916 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(239): region to add: 84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:25,916 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(239): region to add: 3f67bab442b50e260b213bb216916965 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(239): region to add: 7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(239): region to add: 20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(239): region to add: e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(239): region to add: a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(239): region to add: be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(239): region to add: 0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(585): clone region=f0410aee6a8c37d5108bfc4e72e112ff as f0410aee6a8c37d5108bfc4e72e112ff in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(585): clone region=0812508db509f468361033bc0fee2f89 as 0812508db509f468361033bc0fee2f89 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(585): clone region=84a276df1e06cbad7d635e079454f90f as 84a276df1e06cbad7d635e079454f90f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(585): clone region=3f67bab442b50e260b213bb216916965 as 3f67bab442b50e260b213bb216916965 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(585): clone region=7f512703cd1cf77f16739c1668e6bf17 as 7f512703cd1cf77f16739c1668e6bf17 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(585): clone region=20ea34416c70729c1f49ad26d44cc554 as 20ea34416c70729c1f49ad26d44cc554 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(585): clone region=e607e14d285a83ed1504025b564b08b5 as e607e14d285a83ed1504025b564b08b5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(585): clone region=a3ca5e20630f4094ffb524cfe766fc59 as a3ca5e20630f4094ffb524cfe766fc59 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(585): clone region=be65b27959e3e6148503368d367bb9c8 as be65b27959e3e6148503368d367bb9c8 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:25,917 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(585): clone region=0c9883f7fe6f5e63fd6edafb3e54b69d as 0c9883f7fe6f5e63fd6edafb3e54b69d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 23:01:25,918 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => f0410aee6a8c37d5108bfc4e72e112ff, NAME => 'testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3 2023-02-15 23:01:25,919 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 84a276df1e06cbad7d635e079454f90f, NAME => 'testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3 2023-02-15 23:01:25,919 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0812508db509f468361033bc0fee2f89, NAME => 'testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3 2023-02-15 23:01:25,919 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 3f67bab442b50e260b213bb216916965, NAME => 'testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3 2023-02-15 23:01:25,920 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 7f512703cd1cf77f16739c1668e6bf17, NAME => 'testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3 2023-02-15 23:01:25,921 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => e607e14d285a83ed1504025b564b08b5, NAME => 'testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3 2023-02-15 23:01:25,921 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 20ea34416c70729c1f49ad26d44cc554, NAME => 'testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3 2023-02-15 23:01:25,922 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => a3ca5e20630f4094ffb524cfe766fc59, NAME => 'testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3 2023-02-15 23:01:25,932 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:25,932 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b04736a42cc743728207a22e194e5b4d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,936 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:25,937 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5a19d103646a4c72a368ce9d93546526 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,940 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:25,940 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2450451eccaa4274873081b7bb8d2c1d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,945 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3917048f2c0e49d2a7a941f40799cd0f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,946 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d6001e2ce50c46e5b6e3725e753fca55 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,946 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5e5455f1b7664fdab7af04fd83c28f18 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,947 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:25,947 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bf80d28c57a24e688020a9d367ae8604 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,956 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 681b7bc1dada445d81d966b4ac590a97 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,956 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 7f512703cd1cf77f16739c1668e6bf17, disabling compactions & flushes 2023-02-15 23:01:25,956 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:25,956 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:25,956 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing f0410aee6a8c37d5108bfc4e72e112ff, disabling compactions & flushes 2023-02-15 23:01:25,956 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. after waiting 0 ms 2023-02-15 23:01:25,956 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:25,956 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:25,956 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:25,956 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:25,956 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 7f512703cd1cf77f16739c1668e6bf17: 2023-02-15 23:01:25,957 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. after waiting 0 ms 2023-02-15 23:01:25,957 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:25,957 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:25,957 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for f0410aee6a8c37d5108bfc4e72e112ff: 2023-02-15 23:01:25,958 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => be65b27959e3e6148503368d367bb9c8, NAME => 'testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3 2023-02-15 23:01:25,958 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0c9883f7fe6f5e63fd6edafb3e54b69d, NAME => 'testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3 2023-02-15 23:01:25,964 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 0812508db509f468361033bc0fee2f89, disabling compactions & flushes 2023-02-15 23:01:25,964 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:25,964 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:25,964 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. after waiting 0 ms 2023-02-15 23:01:25,964 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:25,964 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:25,964 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:25,964 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 0812508db509f468361033bc0fee2f89: 2023-02-15 23:01:25,964 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 72112428c2e34f14ad52703d0113cf9e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,965 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:25,965 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 02f8eb082c80449582f8438b9cdbc180 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,966 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:25,966 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing e607e14d285a83ed1504025b564b08b5, disabling compactions & flushes 2023-02-15 23:01:25,966 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:25,966 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:25,966 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. after waiting 0 ms 2023-02-15 23:01:25,966 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:25,966 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:25,966 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for e607e14d285a83ed1504025b564b08b5: 2023-02-15 23:01:25,972 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 84a276df1e06cbad7d635e079454f90f, disabling compactions & flushes 2023-02-15 23:01:25,972 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:25,972 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:25,972 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:25,972 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e4f219fd2dfb440b9ca4c2adc2d92cde from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,972 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. after waiting 0 ms 2023-02-15 23:01:25,972 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:25,972 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:25,972 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 84a276df1e06cbad7d635e079454f90f: 2023-02-15 23:01:25,975 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 53cf0c6bf2d84aaab89e5d1dac427116 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,975 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e3a562b17adc4c5b9a6a7d4d1ddd431a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,976 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6686afd8fa2f4acb98d3874cba9b087c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,981 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 20ea34416c70729c1f49ad26d44cc554, disabling compactions & flushes 2023-02-15 23:01:25,981 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:25,981 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:25,981 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. after waiting 0 ms 2023-02-15 23:01:25,981 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:25,981 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:25,981 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 20ea34416c70729c1f49ad26d44cc554: 2023-02-15 23:01:25,981 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing a3ca5e20630f4094ffb524cfe766fc59, disabling compactions & flushes 2023-02-15 23:01:25,981 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:25,981 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:25,981 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. after waiting 0 ms 2023-02-15 23:01:25,981 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:25,981 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:25,981 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for a3ca5e20630f4094ffb524cfe766fc59: 2023-02-15 23:01:25,983 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:25,983 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:25,983 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing be65b27959e3e6148503368d367bb9c8, disabling compactions & flushes 2023-02-15 23:01:25,983 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 13c1ea8ad5274429ae3f40faa05ea365 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,983 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:25,983 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:25,983 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. after waiting 0 ms 2023-02-15 23:01:25,983 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:25,983 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:25,983 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for be65b27959e3e6148503368d367bb9c8: 2023-02-15 23:01:25,985 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f8701f4b068940bb95f003a49f2c7c13 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 23:01:25,986 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 3f67bab442b50e260b213bb216916965, disabling compactions & flushes 2023-02-15 23:01:25,986 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:25,986 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:25,986 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. after waiting 0 ms 2023-02-15 23:01:25,986 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:25,986 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:25,986 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 3f67bab442b50e260b213bb216916965: 2023-02-15 23:01:25,987 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 0c9883f7fe6f5e63fd6edafb3e54b69d, disabling compactions & flushes 2023-02-15 23:01:25,987 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:25,987 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:25,987 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. after waiting 0 ms 2023-02-15 23:01:25,987 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:25,987 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:25,987 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 0c9883f7fe6f5e63fd6edafb3e54b69d: 2023-02-15 23:01:25,987 INFO [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676502083608 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:25,988 DEBUG [Listener at localhost/45623] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3 2023-02-15 23:01:25,988 DEBUG [Listener at localhost/45623] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3 2023-02-15 23:01:25,988 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-data/ 2023-02-15 23:01:25,989 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |----default/ 2023-02-15 23:01:25,989 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-15 23:01:25,990 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |----------0812508db509f468361033bc0fee2f89/ 2023-02-15 23:01:25,990 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:25,991 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:25,991 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=0812508db509f468361033bc0fee2f89-2450451eccaa4274873081b7bb8d2c1d 2023-02-15 23:01:25,991 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:25,992 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=0812508db509f468361033bc0fee2f89-5e5455f1b7664fdab7af04fd83c28f18 2023-02-15 23:01:25,992 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |----------0c9883f7fe6f5e63fd6edafb3e54b69d/ 2023-02-15 23:01:25,992 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:25,992 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:25,993 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=0c9883f7fe6f5e63fd6edafb3e54b69d-13c1ea8ad5274429ae3f40faa05ea365 2023-02-15 23:01:25,993 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:25,993 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=0c9883f7fe6f5e63fd6edafb3e54b69d-f8701f4b068940bb95f003a49f2c7c13 2023-02-15 23:01:25,993 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |----------20ea34416c70729c1f49ad26d44cc554/ 2023-02-15 23:01:25,994 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:25,994 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:25,994 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=20ea34416c70729c1f49ad26d44cc554-02f8eb082c80449582f8438b9cdbc180 2023-02-15 23:01:25,994 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:25,995 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=20ea34416c70729c1f49ad26d44cc554-6686afd8fa2f4acb98d3874cba9b087c 2023-02-15 23:01:25,995 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |----------3f67bab442b50e260b213bb216916965/ 2023-02-15 23:01:25,995 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:25,995 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:25,996 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=3f67bab442b50e260b213bb216916965-e4f219fd2dfb440b9ca4c2adc2d92cde 2023-02-15 23:01:25,996 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:25,996 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=3f67bab442b50e260b213bb216916965-53cf0c6bf2d84aaab89e5d1dac427116 2023-02-15 23:01:25,996 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |----------7f512703cd1cf77f16739c1668e6bf17/ 2023-02-15 23:01:25,997 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:25,997 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:25,997 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=7f512703cd1cf77f16739c1668e6bf17-5a19d103646a4c72a368ce9d93546526 2023-02-15 23:01:25,997 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:25,998 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=7f512703cd1cf77f16739c1668e6bf17-d6001e2ce50c46e5b6e3725e753fca55 2023-02-15 23:01:25,998 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |----------84a276df1e06cbad7d635e079454f90f/ 2023-02-15 23:01:25,998 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:25,999 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:25,999 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=84a276df1e06cbad7d635e079454f90f-bf80d28c57a24e688020a9d367ae8604 2023-02-15 23:01:25,999 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:25,999 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=84a276df1e06cbad7d635e079454f90f-681b7bc1dada445d81d966b4ac590a97 2023-02-15 23:01:26,000 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |----------a3ca5e20630f4094ffb524cfe766fc59/ 2023-02-15 23:01:26,000 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:26,000 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:26,001 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=a3ca5e20630f4094ffb524cfe766fc59-72112428c2e34f14ad52703d0113cf9e 2023-02-15 23:01:26,001 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:26,001 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=a3ca5e20630f4094ffb524cfe766fc59-e3a562b17adc4c5b9a6a7d4d1ddd431a 2023-02-15 23:01:26,001 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |----------be65b27959e3e6148503368d367bb9c8/ 2023-02-15 23:01:26,002 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:26,002 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |----------e607e14d285a83ed1504025b564b08b5/ 2023-02-15 23:01:26,002 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:26,002 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |----------f0410aee6a8c37d5108bfc4e72e112ff/ 2023-02-15 23:01:26,003 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:26,003 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:26,003 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=f0410aee6a8c37d5108bfc4e72e112ff-b04736a42cc743728207a22e194e5b4d 2023-02-15 23:01:26,003 DEBUG [Listener at localhost/45623] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:26,004 DEBUG [Listener at localhost/45623] util.CommonFSUtils(702): |----------------testWithMapReduce=f0410aee6a8c37d5108bfc4e72e112ff-3917048f2c0e49d2a7a941f40799cd0f 2023-02-15 23:01:26,004 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,005 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,005 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,006 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,006 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,007 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,007 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,082 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/hadoop-3051834464473595199.jar 2023-02-15 23:01:26,082 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,083 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,083 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,084 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,084 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,085 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,085 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-15 23:01:26,086 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-15 23:01:26,086 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-15 23:01:26,086 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-15 23:01:26,087 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-15 23:01:26,087 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-15 23:01:26,087 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-15 23:01:26,088 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-15 23:01:26,088 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-15 23:01:26,089 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-15 23:01:26,089 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:26,089 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 23:01:26,090 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 23:01:26,090 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 23:01:26,090 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 23:01:26,156 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/hadoop-5932500621343678223.jar 2023-02-15 23:01:26,156 DEBUG [Listener at localhost/45623] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 23:01:26,162 WARN [Listener at localhost/45623] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-15 23:01:26,192 INFO [Listener at localhost/45623] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 23:01:26,292 WARN [Listener at localhost/45623] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/mapreduce.cluster.local.dir/1676502086262/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-15 23:01:26,293 WARN [Listener at localhost/45623] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/mapreduce.cluster.local.dir/1676502086262/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-15 23:01:26,325 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:26,325 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:26,326 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:26,327 INFO [StoreOpener-0812508db509f468361033bc0fee2f89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0812508db509f468361033bc0fee2f89 2023-02-15 23:01:26,328 DEBUG [StoreOpener-0812508db509f468361033bc0fee2f89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f1 2023-02-15 23:01:26,328 INFO [StoreOpener-0812508db509f468361033bc0fee2f89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0812508db509f468361033bc0fee2f89 columnFamilyName f1 2023-02-15 23:01:26,333 DEBUG [StoreOpener-0812508db509f468361033bc0fee2f89-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f1/testWithMapReduce=0812508db509f468361033bc0fee2f89-2450451eccaa4274873081b7bb8d2c1d 2023-02-15 23:01:26,334 INFO [StoreOpener-0812508db509f468361033bc0fee2f89-1] regionserver.HStore(310): Store=0812508db509f468361033bc0fee2f89/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,334 INFO [StoreOpener-0812508db509f468361033bc0fee2f89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0812508db509f468361033bc0fee2f89 2023-02-15 23:01:26,335 DEBUG [StoreOpener-0812508db509f468361033bc0fee2f89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f2 2023-02-15 23:01:26,335 INFO [StoreOpener-0812508db509f468361033bc0fee2f89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0812508db509f468361033bc0fee2f89 columnFamilyName f2 2023-02-15 23:01:26,340 DEBUG [StoreOpener-0812508db509f468361033bc0fee2f89-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/0812508db509f468361033bc0fee2f89/f2/testWithMapReduce=0812508db509f468361033bc0fee2f89-5e5455f1b7664fdab7af04fd83c28f18 2023-02-15 23:01:26,340 INFO [StoreOpener-0812508db509f468361033bc0fee2f89-1] regionserver.HStore(310): Store=0812508db509f468361033bc0fee2f89/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,340 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:26,340 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0812508db509f468361033bc0fee2f89; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74751453, jitterRate=0.11388345062732697}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:26,340 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0812508db509f468361033bc0fee2f89: 2023-02-15 23:01:26,373 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0812508db509f468361033bc0fee2f89, disabling compactions & flushes 2023-02-15 23:01:26,373 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:26,373 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:26,373 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. after waiting 0 ms 2023-02-15 23:01:26,373 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:26,374 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676502082745.0812508db509f468361033bc0fee2f89. 2023-02-15 23:01:26,374 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0812508db509f468361033bc0fee2f89: 2023-02-15 23:01:26,378 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:26,378 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:26,380 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:26,382 INFO [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:26,383 DEBUG [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f1 2023-02-15 23:01:26,383 INFO [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c9883f7fe6f5e63fd6edafb3e54b69d columnFamilyName f1 2023-02-15 23:01:26,388 DEBUG [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f1/testWithMapReduce=0c9883f7fe6f5e63fd6edafb3e54b69d-13c1ea8ad5274429ae3f40faa05ea365 2023-02-15 23:01:26,388 INFO [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] regionserver.HStore(310): Store=0c9883f7fe6f5e63fd6edafb3e54b69d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,388 INFO [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0c9883f7fe6f5e63fd6edafb3e54b69d 2023-02-15 23:01:26,389 DEBUG [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f2 2023-02-15 23:01:26,390 INFO [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c9883f7fe6f5e63fd6edafb3e54b69d columnFamilyName f2 2023-02-15 23:01:26,395 DEBUG [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/0c9883f7fe6f5e63fd6edafb3e54b69d/f2/testWithMapReduce=0c9883f7fe6f5e63fd6edafb3e54b69d-f8701f4b068940bb95f003a49f2c7c13 2023-02-15 23:01:26,395 INFO [StoreOpener-0c9883f7fe6f5e63fd6edafb3e54b69d-1] regionserver.HStore(310): Store=0c9883f7fe6f5e63fd6edafb3e54b69d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,395 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:26,395 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0c9883f7fe6f5e63fd6edafb3e54b69d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59008905, jitterRate=-0.12069879472255707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:26,395 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0c9883f7fe6f5e63fd6edafb3e54b69d: 2023-02-15 23:01:26,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0c9883f7fe6f5e63fd6edafb3e54b69d, disabling compactions & flushes 2023-02-15 23:01:26,430 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:26,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:26,431 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. after waiting 0 ms 2023-02-15 23:01:26,431 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:26,431 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676502082745.0c9883f7fe6f5e63fd6edafb3e54b69d. 2023-02-15 23:01:26,432 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0c9883f7fe6f5e63fd6edafb3e54b69d: 2023-02-15 23:01:26,436 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:26,436 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:26,439 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:26,441 INFO [StoreOpener-3f67bab442b50e260b213bb216916965-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f67bab442b50e260b213bb216916965 2023-02-15 23:01:26,442 DEBUG [StoreOpener-3f67bab442b50e260b213bb216916965-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f1 2023-02-15 23:01:26,442 INFO [StoreOpener-3f67bab442b50e260b213bb216916965-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f67bab442b50e260b213bb216916965 columnFamilyName f1 2023-02-15 23:01:26,452 DEBUG [StoreOpener-3f67bab442b50e260b213bb216916965-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f1/testWithMapReduce=3f67bab442b50e260b213bb216916965-e4f219fd2dfb440b9ca4c2adc2d92cde 2023-02-15 23:01:26,453 INFO [StoreOpener-3f67bab442b50e260b213bb216916965-1] regionserver.HStore(310): Store=3f67bab442b50e260b213bb216916965/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,453 INFO [StoreOpener-3f67bab442b50e260b213bb216916965-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f67bab442b50e260b213bb216916965 2023-02-15 23:01:26,454 DEBUG [StoreOpener-3f67bab442b50e260b213bb216916965-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f2 2023-02-15 23:01:26,454 INFO [StoreOpener-3f67bab442b50e260b213bb216916965-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f67bab442b50e260b213bb216916965 columnFamilyName f2 2023-02-15 23:01:26,458 DEBUG [StoreOpener-3f67bab442b50e260b213bb216916965-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/3f67bab442b50e260b213bb216916965/f2/testWithMapReduce=3f67bab442b50e260b213bb216916965-53cf0c6bf2d84aaab89e5d1dac427116 2023-02-15 23:01:26,458 INFO [StoreOpener-3f67bab442b50e260b213bb216916965-1] regionserver.HStore(310): Store=3f67bab442b50e260b213bb216916965/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,459 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:26,459 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3f67bab442b50e260b213bb216916965; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71573556, jitterRate=0.06652909517288208}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:26,459 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3f67bab442b50e260b213bb216916965: 2023-02-15 23:01:26,487 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3f67bab442b50e260b213bb216916965, disabling compactions & flushes 2023-02-15 23:01:26,487 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:26,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:26,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. after waiting 0 ms 2023-02-15 23:01:26,488 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:26,489 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676502082745.3f67bab442b50e260b213bb216916965. 2023-02-15 23:01:26,489 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3f67bab442b50e260b213bb216916965: 2023-02-15 23:01:26,493 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:26,493 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:26,496 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:26,498 INFO [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:26,499 DEBUG [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f1 2023-02-15 23:01:26,499 INFO [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20ea34416c70729c1f49ad26d44cc554 columnFamilyName f1 2023-02-15 23:01:26,505 DEBUG [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f1/testWithMapReduce=20ea34416c70729c1f49ad26d44cc554-02f8eb082c80449582f8438b9cdbc180 2023-02-15 23:01:26,505 INFO [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] regionserver.HStore(310): Store=20ea34416c70729c1f49ad26d44cc554/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,505 INFO [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 20ea34416c70729c1f49ad26d44cc554 2023-02-15 23:01:26,506 DEBUG [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f2 2023-02-15 23:01:26,507 INFO [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20ea34416c70729c1f49ad26d44cc554 columnFamilyName f2 2023-02-15 23:01:26,511 DEBUG [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/20ea34416c70729c1f49ad26d44cc554/f2/testWithMapReduce=20ea34416c70729c1f49ad26d44cc554-6686afd8fa2f4acb98d3874cba9b087c 2023-02-15 23:01:26,512 INFO [StoreOpener-20ea34416c70729c1f49ad26d44cc554-1] regionserver.HStore(310): Store=20ea34416c70729c1f49ad26d44cc554/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,512 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:26,512 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 20ea34416c70729c1f49ad26d44cc554; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75076649, jitterRate=0.11872924864292145}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:26,512 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 20ea34416c70729c1f49ad26d44cc554: 2023-02-15 23:01:26,550 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 20ea34416c70729c1f49ad26d44cc554, disabling compactions & flushes 2023-02-15 23:01:26,551 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:26,551 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:26,551 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. after waiting 0 ms 2023-02-15 23:01:26,551 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:26,552 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676502082745.20ea34416c70729c1f49ad26d44cc554. 2023-02-15 23:01:26,552 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 20ea34416c70729c1f49ad26d44cc554: 2023-02-15 23:01:26,556 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:26,556 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:26,557 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:26,559 INFO [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:26,560 DEBUG [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f1 2023-02-15 23:01:26,560 INFO [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f512703cd1cf77f16739c1668e6bf17 columnFamilyName f1 2023-02-15 23:01:26,564 DEBUG [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f1/testWithMapReduce=7f512703cd1cf77f16739c1668e6bf17-5a19d103646a4c72a368ce9d93546526 2023-02-15 23:01:26,564 INFO [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] regionserver.HStore(310): Store=7f512703cd1cf77f16739c1668e6bf17/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,564 INFO [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7f512703cd1cf77f16739c1668e6bf17 2023-02-15 23:01:26,565 DEBUG [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f2 2023-02-15 23:01:26,566 INFO [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f512703cd1cf77f16739c1668e6bf17 columnFamilyName f2 2023-02-15 23:01:26,570 DEBUG [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/7f512703cd1cf77f16739c1668e6bf17/f2/testWithMapReduce=7f512703cd1cf77f16739c1668e6bf17-d6001e2ce50c46e5b6e3725e753fca55 2023-02-15 23:01:26,570 INFO [StoreOpener-7f512703cd1cf77f16739c1668e6bf17-1] regionserver.HStore(310): Store=7f512703cd1cf77f16739c1668e6bf17/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,570 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:26,570 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7f512703cd1cf77f16739c1668e6bf17; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65917969, jitterRate=-0.017745718359947205}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:26,570 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7f512703cd1cf77f16739c1668e6bf17: 2023-02-15 23:01:26,597 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7f512703cd1cf77f16739c1668e6bf17, disabling compactions & flushes 2023-02-15 23:01:26,597 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:26,597 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:26,597 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. after waiting 0 ms 2023-02-15 23:01:26,597 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:26,598 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676502082745.7f512703cd1cf77f16739c1668e6bf17. 2023-02-15 23:01:26,598 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7f512703cd1cf77f16739c1668e6bf17: 2023-02-15 23:01:26,602 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:26,602 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:26,607 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:26,609 INFO [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:26,610 DEBUG [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/e607e14d285a83ed1504025b564b08b5/f1 2023-02-15 23:01:26,611 INFO [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e607e14d285a83ed1504025b564b08b5 columnFamilyName f1 2023-02-15 23:01:26,611 INFO [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] regionserver.HStore(310): Store=e607e14d285a83ed1504025b564b08b5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,611 INFO [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e607e14d285a83ed1504025b564b08b5 2023-02-15 23:01:26,612 DEBUG [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/e607e14d285a83ed1504025b564b08b5/f2 2023-02-15 23:01:26,613 INFO [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e607e14d285a83ed1504025b564b08b5 columnFamilyName f2 2023-02-15 23:01:26,613 INFO [StoreOpener-e607e14d285a83ed1504025b564b08b5-1] regionserver.HStore(310): Store=e607e14d285a83ed1504025b564b08b5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:26,613 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e607e14d285a83ed1504025b564b08b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59762743, jitterRate=-0.10946573317050934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:26,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e607e14d285a83ed1504025b564b08b5: 2023-02-15 23:01:26,631 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e607e14d285a83ed1504025b564b08b5, disabling compactions & flushes 2023-02-15 23:01:26,631 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:26,631 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:26,631 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. after waiting 0 ms 2023-02-15 23:01:26,631 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:26,632 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676502082745.e607e14d285a83ed1504025b564b08b5. 2023-02-15 23:01:26,632 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e607e14d285a83ed1504025b564b08b5: 2023-02-15 23:01:26,635 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:26,635 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:26,636 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:26,638 INFO [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:26,638 DEBUG [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f1 2023-02-15 23:01:26,639 INFO [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3ca5e20630f4094ffb524cfe766fc59 columnFamilyName f1 2023-02-15 23:01:26,643 DEBUG [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f1/testWithMapReduce=a3ca5e20630f4094ffb524cfe766fc59-72112428c2e34f14ad52703d0113cf9e 2023-02-15 23:01:26,643 INFO [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] regionserver.HStore(310): Store=a3ca5e20630f4094ffb524cfe766fc59/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,643 INFO [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a3ca5e20630f4094ffb524cfe766fc59 2023-02-15 23:01:26,644 DEBUG [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f2 2023-02-15 23:01:26,644 INFO [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3ca5e20630f4094ffb524cfe766fc59 columnFamilyName f2 2023-02-15 23:01:26,648 DEBUG [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/a3ca5e20630f4094ffb524cfe766fc59/f2/testWithMapReduce=a3ca5e20630f4094ffb524cfe766fc59-e3a562b17adc4c5b9a6a7d4d1ddd431a 2023-02-15 23:01:26,648 INFO [StoreOpener-a3ca5e20630f4094ffb524cfe766fc59-1] regionserver.HStore(310): Store=a3ca5e20630f4094ffb524cfe766fc59/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,649 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:26,649 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a3ca5e20630f4094ffb524cfe766fc59; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66792750, jitterRate=-0.004710465669631958}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:26,649 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a3ca5e20630f4094ffb524cfe766fc59: 2023-02-15 23:01:26,676 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a3ca5e20630f4094ffb524cfe766fc59, disabling compactions & flushes 2023-02-15 23:01:26,676 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:26,676 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:26,676 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. after waiting 0 ms 2023-02-15 23:01:26,676 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:26,677 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676502082745.a3ca5e20630f4094ffb524cfe766fc59. 2023-02-15 23:01:26,677 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a3ca5e20630f4094ffb524cfe766fc59: 2023-02-15 23:01:26,680 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:26,680 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:26,681 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:26,682 INFO [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:26,683 DEBUG [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f1 2023-02-15 23:01:26,684 INFO [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84a276df1e06cbad7d635e079454f90f columnFamilyName f1 2023-02-15 23:01:26,688 DEBUG [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f1/testWithMapReduce=84a276df1e06cbad7d635e079454f90f-bf80d28c57a24e688020a9d367ae8604 2023-02-15 23:01:26,688 INFO [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] regionserver.HStore(310): Store=84a276df1e06cbad7d635e079454f90f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,688 INFO [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 84a276df1e06cbad7d635e079454f90f 2023-02-15 23:01:26,689 DEBUG [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f2 2023-02-15 23:01:26,689 INFO [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84a276df1e06cbad7d635e079454f90f columnFamilyName f2 2023-02-15 23:01:26,693 DEBUG [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/84a276df1e06cbad7d635e079454f90f/f2/testWithMapReduce=84a276df1e06cbad7d635e079454f90f-681b7bc1dada445d81d966b4ac590a97 2023-02-15 23:01:26,693 INFO [StoreOpener-84a276df1e06cbad7d635e079454f90f-1] regionserver.HStore(310): Store=84a276df1e06cbad7d635e079454f90f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,693 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:26,693 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 84a276df1e06cbad7d635e079454f90f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67580701, jitterRate=0.007030919194221497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:26,693 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 84a276df1e06cbad7d635e079454f90f: 2023-02-15 23:01:26,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 84a276df1e06cbad7d635e079454f90f, disabling compactions & flushes 2023-02-15 23:01:26,722 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:26,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:26,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. after waiting 0 ms 2023-02-15 23:01:26,723 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:26,723 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676502082745.84a276df1e06cbad7d635e079454f90f. 2023-02-15 23:01:26,723 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 84a276df1e06cbad7d635e079454f90f: 2023-02-15 23:01:26,726 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:26,726 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:26,728 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:26,730 INFO [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:26,731 DEBUG [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f1 2023-02-15 23:01:26,731 INFO [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0410aee6a8c37d5108bfc4e72e112ff columnFamilyName f1 2023-02-15 23:01:26,736 DEBUG [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f1/testWithMapReduce=f0410aee6a8c37d5108bfc4e72e112ff-b04736a42cc743728207a22e194e5b4d 2023-02-15 23:01:26,736 INFO [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] regionserver.HStore(310): Store=f0410aee6a8c37d5108bfc4e72e112ff/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,736 INFO [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f0410aee6a8c37d5108bfc4e72e112ff 2023-02-15 23:01:26,737 DEBUG [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f2 2023-02-15 23:01:26,738 INFO [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0410aee6a8c37d5108bfc4e72e112ff columnFamilyName f2 2023-02-15 23:01:26,742 DEBUG [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] regionserver.HStore(539): loaded hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/f0410aee6a8c37d5108bfc4e72e112ff/f2/testWithMapReduce=f0410aee6a8c37d5108bfc4e72e112ff-3917048f2c0e49d2a7a941f40799cd0f 2023-02-15 23:01:26,742 INFO [StoreOpener-f0410aee6a8c37d5108bfc4e72e112ff-1] regionserver.HStore(310): Store=f0410aee6a8c37d5108bfc4e72e112ff/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,742 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:26,742 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f0410aee6a8c37d5108bfc4e72e112ff; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66546387, jitterRate=-0.008381560444831848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:26,743 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f0410aee6a8c37d5108bfc4e72e112ff: 2023-02-15 23:01:26,778 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f0410aee6a8c37d5108bfc4e72e112ff, disabling compactions & flushes 2023-02-15 23:01:26,778 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:26,778 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:26,778 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. after waiting 0 ms 2023-02-15 23:01:26,778 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:26,779 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676502082745.f0410aee6a8c37d5108bfc4e72e112ff. 2023-02-15 23:01:26,779 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f0410aee6a8c37d5108bfc4e72e112ff: 2023-02-15 23:01:26,782 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:26,782 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:26,786 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:26,789 INFO [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:26,791 DEBUG [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/be65b27959e3e6148503368d367bb9c8/f1 2023-02-15 23:01:26,791 INFO [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be65b27959e3e6148503368d367bb9c8 columnFamilyName f1 2023-02-15 23:01:26,791 INFO [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] regionserver.HStore(310): Store=be65b27959e3e6148503368d367bb9c8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,791 INFO [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region be65b27959e3e6148503368d367bb9c8 2023-02-15 23:01:26,792 DEBUG [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44419/user/jenkins/test-data/940ca8cd-5f86-0959-389d-40c478c104bb/testWithMapReduceAndOfflineHBaseMultiRegion/4c1b7f67-9787-424c-a9aa-e32a95cc8ed3/data/default/testWithMapReduce/be65b27959e3e6148503368d367bb9c8/f2 2023-02-15 23:01:26,793 INFO [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be65b27959e3e6148503368d367bb9c8 columnFamilyName f2 2023-02-15 23:01:26,793 INFO [StoreOpener-be65b27959e3e6148503368d367bb9c8-1] regionserver.HStore(310): Store=be65b27959e3e6148503368d367bb9c8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:26,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:26,794 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened be65b27959e3e6148503368d367bb9c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72149297, jitterRate=0.07510830461978912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:26,794 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for be65b27959e3e6148503368d367bb9c8: 2023-02-15 23:01:26,812 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing be65b27959e3e6148503368d367bb9c8, disabling compactions & flushes 2023-02-15 23:01:26,812 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:26,812 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:26,812 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. after waiting 0 ms 2023-02-15 23:01:26,812 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:26,812 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676502082745.be65b27959e3e6148503368d367bb9c8. 2023-02-15 23:01:26,812 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for be65b27959e3e6148503368d367bb9c8: 2023-02-15 23:01:27,327 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 23:01:27,328 WARN [Listener at localhost/45623] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:27,331 INFO [Listener at localhost/45623] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:27,437 WARN [BP-1610546993-172.31.14.131-1676502079052 heartbeating to localhost/127.0.0.1:44419] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 23:01:27,438 WARN [BP-1610546993-172.31.14.131-1676502079052 heartbeating to localhost/127.0.0.1:44419] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1610546993-172.31.14.131-1676502079052 (Datanode Uuid c23a6183-2743-435f-a48a-8a70c19d59ef) service to localhost/127.0.0.1:44419 2023-02-15 23:01:27,438 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/cluster_2cd0fec7-0b23-fe3e-1d62-24f8eb56b933/dfs/data/data3/current/BP-1610546993-172.31.14.131-1676502079052] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:27,439 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/cluster_2cd0fec7-0b23-fe3e-1d62-24f8eb56b933/dfs/data/data4/current/BP-1610546993-172.31.14.131-1676502079052] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:27,440 WARN [Listener at localhost/45623] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:27,443 INFO [Listener at localhost/45623] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:27,546 WARN [BP-1610546993-172.31.14.131-1676502079052 heartbeating to localhost/127.0.0.1:44419] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 23:01:27,547 WARN [BP-1610546993-172.31.14.131-1676502079052 heartbeating to localhost/127.0.0.1:44419] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1610546993-172.31.14.131-1676502079052 (Datanode Uuid 660d5474-60bb-475e-8a19-99476ecdd02b) service to localhost/127.0.0.1:44419 2023-02-15 23:01:27,547 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/cluster_2cd0fec7-0b23-fe3e-1d62-24f8eb56b933/dfs/data/data1/current/BP-1610546993-172.31.14.131-1676502079052] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:27,548 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/cluster_2cd0fec7-0b23-fe3e-1d62-24f8eb56b933/dfs/data/data2/current/BP-1610546993-172.31.14.131-1676502079052] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:27,557 INFO [Listener at localhost/45623] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:27,618 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 23:01:27,678 INFO [Listener at localhost/45623] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 23:01:27,724 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 23:01:27,739 INFO [Listener at localhost/45623] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=157 (was 101) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:44419 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:44419 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:44419 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/45623 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:44419 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44419 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35535,1676502081395)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:44419 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:44419 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=540 (was 550), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=363 (was 411), ProcessCount=166 (was 166), AvailableMemoryMB=2645 (was 2869) 2023-02-15 23:01:27,753 INFO [Listener at localhost/45623] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=157, OpenFileDescriptor=540, MaxFileDescriptor=60000, SystemLoadAverage=363, ProcessCount=166, AvailableMemoryMB=2645 2023-02-15 23:01:27,763 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/hadoop.log.dir so I do NOT create it in target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12 2023-02-15 23:01:27,764 WARN [Listener at localhost/45623] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 23:01:27,764 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/hadoop.tmp.dir so I do NOT create it in target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12 2023-02-15 23:01:27,764 WARN [Listener at localhost/45623] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6fb528d9-12e9-06c6-9f64-f260e4c7463e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 23:01:27,764 DEBUG [Listener at localhost/45623] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12 2023-02-15 23:01:27,764 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 23:01:27,764 INFO [Listener at localhost/45623] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/cluster_37bd62d9-b09a-2614-f40b-d447d92e1626, deleteOnExit=true 2023-02-15 23:01:27,764 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 23:01:27,764 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/test.cache.data in system properties and HBase conf 2023-02-15 23:01:27,764 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 23:01:27,764 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/hadoop.log.dir in system properties and HBase conf 2023-02-15 23:01:27,764 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 23:01:27,765 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 23:01:27,765 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 23:01:27,765 DEBUG [Listener at localhost/45623] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 23:01:27,765 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:01:27,765 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:01:27,765 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 23:01:27,765 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:01:27,765 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 23:01:27,765 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 23:01:27,766 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:01:27,766 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:01:27,766 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 23:01:27,766 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/nfs.dump.dir in system properties and HBase conf 2023-02-15 23:01:27,766 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/java.io.tmpdir in system properties and HBase conf 2023-02-15 23:01:27,766 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:01:27,766 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 23:01:27,766 INFO [Listener at localhost/45623] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 23:01:27,770 WARN [Listener at localhost/45623] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:01:27,770 WARN [Listener at localhost/45623] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:01:27,815 WARN [Listener at localhost/45623] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:27,817 INFO [Listener at localhost/45623] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:27,824 INFO [Listener at localhost/45623] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/java.io.tmpdir/Jetty_localhost_41785_hdfs____ict8jl/webapp 2023-02-15 23:01:27,922 INFO [Listener at localhost/45623] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41785 2023-02-15 23:01:27,927 WARN [Listener at localhost/45623] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:01:27,927 WARN [Listener at localhost/45623] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:01:27,971 WARN [Listener at localhost/32913] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:27,986 WARN [Listener at localhost/32913] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:01:27,988 WARN [Listener at localhost/32913] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:27,989 INFO [Listener at localhost/32913] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:27,993 INFO [Listener at localhost/32913] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/java.io.tmpdir/Jetty_localhost_39605_datanode____.uxips4/webapp 2023-02-15 23:01:28,086 INFO [Listener at localhost/32913] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39605 2023-02-15 23:01:28,094 WARN [Listener at localhost/46359] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:28,110 WARN [Listener at localhost/46359] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:01:28,113 WARN [Listener at localhost/46359] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:28,115 INFO [Listener at localhost/46359] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:28,118 INFO [Listener at localhost/46359] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/java.io.tmpdir/Jetty_localhost_41967_datanode____2w35vo/webapp 2023-02-15 23:01:28,189 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x808942d6bae38e9b: Processing first storage report for DS-e9357892-434b-4fa7-a536-85514e48eef0 from datanode 8256cabd-406e-4964-aae7-088ad69129fb 2023-02-15 23:01:28,189 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x808942d6bae38e9b: from storage DS-e9357892-434b-4fa7-a536-85514e48eef0 node DatanodeRegistration(127.0.0.1:43699, datanodeUuid=8256cabd-406e-4964-aae7-088ad69129fb, infoPort=33007, infoSecurePort=0, ipcPort=46359, storageInfo=lv=-57;cid=testClusterID;nsid=1087108840;c=1676502087773), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:28,189 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x808942d6bae38e9b: Processing first storage report for DS-4e0559f3-8f5d-4e65-9234-fd8fdf835a11 from datanode 8256cabd-406e-4964-aae7-088ad69129fb 2023-02-15 23:01:28,190 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x808942d6bae38e9b: from storage DS-4e0559f3-8f5d-4e65-9234-fd8fdf835a11 node DatanodeRegistration(127.0.0.1:43699, datanodeUuid=8256cabd-406e-4964-aae7-088ad69129fb, infoPort=33007, infoSecurePort=0, ipcPort=46359, storageInfo=lv=-57;cid=testClusterID;nsid=1087108840;c=1676502087773), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:28,215 INFO [Listener at localhost/46359] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41967 2023-02-15 23:01:28,222 WARN [Listener at localhost/39971] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:28,312 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x11274503e685f0c3: Processing first storage report for DS-307b6cc1-56ca-4fa0-8ece-389d80e93c16 from datanode d8d50a16-e04e-4401-a4ce-254404fbf5d5 2023-02-15 23:01:28,313 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x11274503e685f0c3: from storage DS-307b6cc1-56ca-4fa0-8ece-389d80e93c16 node DatanodeRegistration(127.0.0.1:46591, datanodeUuid=d8d50a16-e04e-4401-a4ce-254404fbf5d5, infoPort=45587, infoSecurePort=0, ipcPort=39971, storageInfo=lv=-57;cid=testClusterID;nsid=1087108840;c=1676502087773), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:28,313 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x11274503e685f0c3: Processing first storage report for DS-6cb4acaf-2b90-40b7-94b3-94af6d02396f from datanode d8d50a16-e04e-4401-a4ce-254404fbf5d5 2023-02-15 23:01:28,313 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x11274503e685f0c3: from storage DS-6cb4acaf-2b90-40b7-94b3-94af6d02396f node DatanodeRegistration(127.0.0.1:46591, datanodeUuid=d8d50a16-e04e-4401-a4ce-254404fbf5d5, infoPort=45587, infoSecurePort=0, ipcPort=39971, storageInfo=lv=-57;cid=testClusterID;nsid=1087108840;c=1676502087773), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:28,330 DEBUG [Listener at localhost/39971] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12 2023-02-15 23:01:28,332 INFO [Listener at localhost/39971] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/cluster_37bd62d9-b09a-2614-f40b-d447d92e1626/zookeeper_0, clientPort=57163, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/cluster_37bd62d9-b09a-2614-f40b-d447d92e1626/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/cluster_37bd62d9-b09a-2614-f40b-d447d92e1626/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 23:01:28,333 INFO [Listener at localhost/39971] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57163 2023-02-15 23:01:28,333 INFO [Listener at localhost/39971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:28,334 INFO [Listener at localhost/39971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:28,348 INFO [Listener at localhost/39971] util.FSUtils(479): Created version file at hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed with version=8 2023-02-15 23:01:28,348 INFO [Listener at localhost/39971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:28,349 INFO [Listener at localhost/39971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:28,350 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:32913/user/jenkins/test-data/f39d96ed-f87c-c829-01b5-e8089a3745c5/hbase-staging 2023-02-15 23:01:28,352 INFO [Listener at localhost/39971] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:28,352 INFO [Listener at localhost/39971] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:28,352 INFO [Listener at localhost/39971] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:28,352 INFO [Listener at localhost/39971] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:28,352 INFO [Listener at localhost/39971] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:28,352 INFO [Listener at localhost/39971] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:28,352 INFO [Listener at localhost/39971] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:28,354 INFO [Listener at localhost/39971] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32933 2023-02-15 23:01:28,354 INFO [Listener at localhost/39971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:28,355 INFO [Listener at localhost/39971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:28,355 INFO [Listener at localhost/39971] zookeeper.RecoverableZooKeeper(93): Process identifier=master:32933 connecting to ZooKeeper ensemble=127.0.0.1:57163 2023-02-15 23:01:28,362 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:329330x0, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:28,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:32933-0x1005a37a4500000 connected 2023-02-15 23:01:28,390 DEBUG [Listener at localhost/39971] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:28,390 DEBUG [Listener at localhost/39971] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:28,390 DEBUG [Listener at localhost/39971] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:28,392 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32933 2023-02-15 23:01:28,392 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32933 2023-02-15 23:01:28,394 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32933 2023-02-15 23:01:28,396 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32933 2023-02-15 23:01:28,396 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32933 2023-02-15 23:01:28,396 INFO [Listener at localhost/39971] master.HMaster(444): hbase.rootdir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed, hbase.cluster.distributed=false 2023-02-15 23:01:28,409 INFO [Listener at localhost/39971] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:28,409 INFO [Listener at localhost/39971] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:28,409 INFO [Listener at localhost/39971] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:28,409 INFO [Listener at localhost/39971] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:28,409 INFO [Listener at localhost/39971] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:28,409 INFO [Listener at localhost/39971] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:28,409 INFO [Listener at localhost/39971] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:28,411 INFO [Listener at localhost/39971] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39295 2023-02-15 23:01:28,411 INFO [Listener at localhost/39971] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:28,412 DEBUG [Listener at localhost/39971] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:28,412 INFO [Listener at localhost/39971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:28,413 INFO [Listener at localhost/39971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:28,414 INFO [Listener at localhost/39971] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39295 connecting to ZooKeeper ensemble=127.0.0.1:57163 2023-02-15 23:01:28,417 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:392950x0, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:28,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39295-0x1005a37a4500001 connected 2023-02-15 23:01:28,418 DEBUG [Listener at localhost/39971] zookeeper.ZKUtil(164): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:28,418 DEBUG [Listener at localhost/39971] zookeeper.ZKUtil(164): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:28,419 DEBUG [Listener at localhost/39971] zookeeper.ZKUtil(164): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:28,419 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39295 2023-02-15 23:01:28,420 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39295 2023-02-15 23:01:28,424 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39295 2023-02-15 23:01:28,428 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39295 2023-02-15 23:01:28,428 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39295 2023-02-15 23:01:28,439 INFO [Listener at localhost/39971] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:28,439 INFO [Listener at localhost/39971] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:28,439 INFO [Listener at localhost/39971] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:28,439 INFO [Listener at localhost/39971] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:28,439 INFO [Listener at localhost/39971] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:28,439 INFO [Listener at localhost/39971] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:28,439 INFO [Listener at localhost/39971] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:28,443 INFO [Listener at localhost/39971] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46759 2023-02-15 23:01:28,444 INFO [Listener at localhost/39971] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:28,445 DEBUG [Listener at localhost/39971] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:28,445 INFO [Listener at localhost/39971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:28,446 INFO [Listener at localhost/39971] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:28,447 INFO [Listener at localhost/39971] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46759 connecting to ZooKeeper ensemble=127.0.0.1:57163 2023-02-15 23:01:28,450 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:467590x0, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:28,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46759-0x1005a37a4500002 connected 2023-02-15 23:01:28,454 DEBUG [Listener at localhost/39971] zookeeper.ZKUtil(164): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:28,454 DEBUG [Listener at localhost/39971] zookeeper.ZKUtil(164): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:28,455 DEBUG [Listener at localhost/39971] zookeeper.ZKUtil(164): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:28,456 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46759 2023-02-15 23:01:28,460 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46759 2023-02-15 23:01:28,460 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46759 2023-02-15 23:01:28,460 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46759 2023-02-15 23:01:28,460 DEBUG [Listener at localhost/39971] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46759 2023-02-15 23:01:28,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,32933,1676502088351 2023-02-15 23:01:28,463 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:28,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,32933,1676502088351 2023-02-15 23:01:28,466 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:28,466 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:28,466 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:28,466 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:28,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:28,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,32933,1676502088351 from backup master directory 2023-02-15 23:01:28,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:28,469 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,32933,1676502088351 2023-02-15 23:01:28,469 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:28,469 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:28,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,32933,1676502088351 2023-02-15 23:01:28,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/hbase.id with ID: 43cc9f70-46c7-45e8-b226-3b60ea100275 2023-02-15 23:01:28,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:28,494 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:28,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x49a31c6c to 127.0.0.1:57163 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:28,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66f7b65e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:28,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:28,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 23:01:28,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:28,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/MasterData/data/master/store-tmp 2023-02-15 23:01:28,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:28,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:28,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:28,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:28,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:28,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:28,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:28,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:28,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/MasterData/WALs/jenkins-hbase4.apache.org,32933,1676502088351 2023-02-15 23:01:28,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32933%2C1676502088351, suffix=, logDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/MasterData/WALs/jenkins-hbase4.apache.org,32933,1676502088351, archiveDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/MasterData/oldWALs, maxLogs=10 2023-02-15 23:01:28,546 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46591,DS-307b6cc1-56ca-4fa0-8ece-389d80e93c16,DISK] 2023-02-15 23:01:28,547 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43699,DS-e9357892-434b-4fa7-a536-85514e48eef0,DISK] 2023-02-15 23:01:28,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/MasterData/WALs/jenkins-hbase4.apache.org,32933,1676502088351/jenkins-hbase4.apache.org%2C32933%2C1676502088351.1676502088527 2023-02-15 23:01:28,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46591,DS-307b6cc1-56ca-4fa0-8ece-389d80e93c16,DISK], DatanodeInfoWithStorage[127.0.0.1:43699,DS-e9357892-434b-4fa7-a536-85514e48eef0,DISK]] 2023-02-15 23:01:28,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:28,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:28,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:28,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:28,554 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:28,555 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 23:01:28,556 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 23:01:28,556 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:28,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:28,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:28,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:28,563 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:28,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74746837, jitterRate=0.11381466686725616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:28,563 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:28,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 23:01:28,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 23:01:28,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 23:01:28,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 23:01:28,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 23:01:28,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 23:01:28,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 23:01:28,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 23:01:28,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 23:01:28,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 23:01:28,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 23:01:28,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 23:01:28,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 23:01:28,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 23:01:28,581 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:28,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 23:01:28,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 23:01:28,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 23:01:28,584 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:28,584 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:28,584 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:28,584 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:28,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,32933,1676502088351, sessionid=0x1005a37a4500000, setting cluster-up flag (Was=false) 2023-02-15 23:01:28,589 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:28,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 23:01:28,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,32933,1676502088351 2023-02-15 23:01:28,597 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:28,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 23:01:28,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,32933,1676502088351 2023-02-15 23:01:28,602 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.hbase-snapshot/.tmp 2023-02-15 23:01:28,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:28,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:28,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:28,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:28,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:28,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 23:01:28,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:28,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676502118605 2023-02-15 23:01:28,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 23:01:28,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 23:01:28,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 23:01:28,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 23:01:28,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 23:01:28,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 23:01:28,606 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:28,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,606 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 23:01:28,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 23:01:28,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 23:01:28,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 23:01:28,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 23:01:28,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 23:01:28,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502088607,5,FailOnTimeoutGroup] 2023-02-15 23:01:28,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502088607,5,FailOnTimeoutGroup] 2023-02-15 23:01:28,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 23:01:28,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,607 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:28,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,619 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:28,619 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:28,620 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed 2023-02-15 23:01:28,630 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:28,634 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:28,635 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/info 2023-02-15 23:01:28,636 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:28,636 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:28,636 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:28,637 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:28,638 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:28,638 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:28,638 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:28,639 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/table 2023-02-15 23:01:28,639 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:28,640 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:28,640 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740 2023-02-15 23:01:28,641 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740 2023-02-15 23:01:28,642 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:28,643 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:28,645 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:28,645 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73289857, jitterRate=0.092103973031044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:28,645 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:28,645 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:28,645 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:28,645 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:28,646 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:28,646 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:28,646 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:28,646 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:28,647 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:28,647 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 23:01:28,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 23:01:28,648 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 23:01:28,650 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 23:01:28,663 INFO [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(952): ClusterId : 43cc9f70-46c7-45e8-b226-3b60ea100275 2023-02-15 23:01:28,663 INFO [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(952): ClusterId : 43cc9f70-46c7-45e8-b226-3b60ea100275 2023-02-15 23:01:28,663 DEBUG [RS:0;jenkins-hbase4:39295] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:28,663 DEBUG [RS:1;jenkins-hbase4:46759] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:28,666 DEBUG [RS:1;jenkins-hbase4:46759] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:28,666 DEBUG [RS:0;jenkins-hbase4:39295] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:28,666 DEBUG [RS:0;jenkins-hbase4:39295] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:28,666 DEBUG [RS:1;jenkins-hbase4:46759] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:28,669 DEBUG [RS:0;jenkins-hbase4:39295] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:28,670 DEBUG [RS:1;jenkins-hbase4:46759] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:28,670 DEBUG [RS:0;jenkins-hbase4:39295] zookeeper.ReadOnlyZKClient(139): Connect 0x62d0295b to 127.0.0.1:57163 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:28,671 DEBUG [RS:1;jenkins-hbase4:46759] zookeeper.ReadOnlyZKClient(139): Connect 0x6d6a9167 to 127.0.0.1:57163 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:28,679 DEBUG [RS:0;jenkins-hbase4:39295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c17cb71, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:28,679 DEBUG [RS:0;jenkins-hbase4:39295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6828422b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:28,679 DEBUG [RS:1;jenkins-hbase4:46759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63ad62ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:28,679 DEBUG [RS:1;jenkins-hbase4:46759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6792fa17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:28,687 DEBUG [RS:0;jenkins-hbase4:39295] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39295 2023-02-15 23:01:28,687 INFO [RS:0;jenkins-hbase4:39295] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:28,687 INFO [RS:0;jenkins-hbase4:39295] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:28,687 DEBUG [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:28,688 INFO [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,32933,1676502088351 with isa=jenkins-hbase4.apache.org/172.31.14.131:39295, startcode=1676502088408 2023-02-15 23:01:28,688 DEBUG [RS:0;jenkins-hbase4:39295] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:28,689 DEBUG [RS:1;jenkins-hbase4:46759] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46759 2023-02-15 23:01:28,689 INFO [RS:1;jenkins-hbase4:46759] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:28,689 INFO [RS:1;jenkins-hbase4:46759] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:28,689 DEBUG [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:28,690 INFO [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,32933,1676502088351 with isa=jenkins-hbase4.apache.org/172.31.14.131:46759, startcode=1676502088438 2023-02-15 23:01:28,690 DEBUG [RS:1;jenkins-hbase4:46759] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:28,690 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42761, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:28,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:28,692 DEBUG [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed 2023-02-15 23:01:28,692 DEBUG [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32913 2023-02-15 23:01:28,692 DEBUG [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:28,693 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54239, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:28,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:28,693 DEBUG [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed 2023-02-15 23:01:28,693 DEBUG [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32913 2023-02-15 23:01:28,693 DEBUG [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:28,694 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:28,697 DEBUG [RS:0;jenkins-hbase4:39295] zookeeper.ZKUtil(162): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:28,697 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46759,1676502088438] 2023-02-15 23:01:28,697 WARN [RS:0;jenkins-hbase4:39295] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:28,697 INFO [RS:0;jenkins-hbase4:39295] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:28,697 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39295,1676502088408] 2023-02-15 23:01:28,697 DEBUG [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/WALs/jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:28,697 DEBUG [RS:1;jenkins-hbase4:46759] zookeeper.ZKUtil(162): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:28,697 WARN [RS:1;jenkins-hbase4:46759] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:28,697 INFO [RS:1;jenkins-hbase4:46759] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:28,697 DEBUG [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/WALs/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:28,702 DEBUG [RS:0;jenkins-hbase4:39295] zookeeper.ZKUtil(162): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:28,702 DEBUG [RS:1;jenkins-hbase4:46759] zookeeper.ZKUtil(162): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:28,702 DEBUG [RS:0;jenkins-hbase4:39295] zookeeper.ZKUtil(162): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:28,702 DEBUG [RS:1;jenkins-hbase4:46759] zookeeper.ZKUtil(162): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:28,703 DEBUG [RS:0;jenkins-hbase4:39295] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:28,703 DEBUG [RS:1;jenkins-hbase4:46759] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:28,703 INFO [RS:0;jenkins-hbase4:39295] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:28,703 INFO [RS:1;jenkins-hbase4:46759] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:28,705 INFO [RS:0;jenkins-hbase4:39295] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:28,708 INFO [RS:0;jenkins-hbase4:39295] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:28,708 INFO [RS:1;jenkins-hbase4:46759] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:28,708 INFO [RS:0;jenkins-hbase4:39295] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,708 INFO [RS:1;jenkins-hbase4:46759] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:28,708 INFO [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:28,708 INFO [RS:1;jenkins-hbase4:46759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,709 INFO [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:28,710 INFO [RS:0;jenkins-hbase4:39295] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,710 INFO [RS:1;jenkins-hbase4:46759] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,710 DEBUG [RS:0;jenkins-hbase4:39295] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,710 DEBUG [RS:1;jenkins-hbase4:46759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,710 DEBUG [RS:0;jenkins-hbase4:39295] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,710 DEBUG [RS:1;jenkins-hbase4:46759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,710 DEBUG [RS:0;jenkins-hbase4:39295] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,710 DEBUG [RS:1;jenkins-hbase4:46759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,710 DEBUG [RS:0;jenkins-hbase4:39295] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,710 DEBUG [RS:1;jenkins-hbase4:46759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,710 DEBUG [RS:0;jenkins-hbase4:39295] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,710 DEBUG [RS:1;jenkins-hbase4:46759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,710 DEBUG [RS:0;jenkins-hbase4:39295] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:28,710 DEBUG [RS:1;jenkins-hbase4:46759] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:28,710 DEBUG [RS:0;jenkins-hbase4:39295] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,710 DEBUG [RS:1;jenkins-hbase4:46759] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,710 DEBUG [RS:0;jenkins-hbase4:39295] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,711 DEBUG [RS:1;jenkins-hbase4:46759] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,711 DEBUG [RS:0;jenkins-hbase4:39295] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,711 DEBUG [RS:1;jenkins-hbase4:46759] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,711 DEBUG [RS:0;jenkins-hbase4:39295] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,711 DEBUG [RS:1;jenkins-hbase4:46759] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:28,712 INFO [RS:0;jenkins-hbase4:39295] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,712 INFO [RS:0;jenkins-hbase4:39295] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,712 INFO [RS:0;jenkins-hbase4:39295] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,716 INFO [RS:1;jenkins-hbase4:46759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,716 INFO [RS:1;jenkins-hbase4:46759] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,716 INFO [RS:1;jenkins-hbase4:46759] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,726 INFO [RS:1;jenkins-hbase4:46759] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:28,726 INFO [RS:0;jenkins-hbase4:39295] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:28,726 INFO [RS:1;jenkins-hbase4:46759] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46759,1676502088438-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,726 INFO [RS:0;jenkins-hbase4:39295] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39295,1676502088408-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:28,738 INFO [RS:0;jenkins-hbase4:39295] regionserver.Replication(203): jenkins-hbase4.apache.org,39295,1676502088408 started 2023-02-15 23:01:28,738 INFO [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39295,1676502088408, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39295, sessionid=0x1005a37a4500001 2023-02-15 23:01:28,738 DEBUG [RS:0;jenkins-hbase4:39295] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:28,738 DEBUG [RS:0;jenkins-hbase4:39295] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:28,738 DEBUG [RS:0;jenkins-hbase4:39295] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39295,1676502088408' 2023-02-15 23:01:28,738 DEBUG [RS:0;jenkins-hbase4:39295] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:28,738 DEBUG [RS:0;jenkins-hbase4:39295] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:28,739 DEBUG [RS:0;jenkins-hbase4:39295] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:28,739 DEBUG [RS:0;jenkins-hbase4:39295] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:28,739 DEBUG [RS:0;jenkins-hbase4:39295] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:28,739 DEBUG [RS:0;jenkins-hbase4:39295] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39295,1676502088408' 2023-02-15 23:01:28,739 DEBUG [RS:0;jenkins-hbase4:39295] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:28,739 DEBUG [RS:0;jenkins-hbase4:39295] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:28,739 DEBUG [RS:0;jenkins-hbase4:39295] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:28,739 INFO [RS:0;jenkins-hbase4:39295] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:28,739 INFO [RS:0;jenkins-hbase4:39295] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:28,743 INFO [RS:1;jenkins-hbase4:46759] regionserver.Replication(203): jenkins-hbase4.apache.org,46759,1676502088438 started 2023-02-15 23:01:28,743 INFO [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46759,1676502088438, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46759, sessionid=0x1005a37a4500002 2023-02-15 23:01:28,744 DEBUG [RS:1;jenkins-hbase4:46759] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:28,744 DEBUG [RS:1;jenkins-hbase4:46759] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:28,744 DEBUG [RS:1;jenkins-hbase4:46759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46759,1676502088438' 2023-02-15 23:01:28,744 DEBUG [RS:1;jenkins-hbase4:46759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:28,744 DEBUG [RS:1;jenkins-hbase4:46759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:28,744 DEBUG [RS:1;jenkins-hbase4:46759] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:28,744 DEBUG [RS:1;jenkins-hbase4:46759] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:28,744 DEBUG [RS:1;jenkins-hbase4:46759] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:28,744 DEBUG [RS:1;jenkins-hbase4:46759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46759,1676502088438' 2023-02-15 23:01:28,744 DEBUG [RS:1;jenkins-hbase4:46759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:28,745 DEBUG [RS:1;jenkins-hbase4:46759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:28,745 DEBUG [RS:1;jenkins-hbase4:46759] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:28,745 INFO [RS:1;jenkins-hbase4:46759] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:28,745 INFO [RS:1;jenkins-hbase4:46759] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:28,800 DEBUG [jenkins-hbase4:32933] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 23:01:28,800 DEBUG [jenkins-hbase4:32933] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:28,802 DEBUG [jenkins-hbase4:32933] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:28,802 DEBUG [jenkins-hbase4:32933] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:28,802 DEBUG [jenkins-hbase4:32933] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:28,803 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46759,1676502088438, state=OPENING 2023-02-15 23:01:28,805 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 23:01:28,806 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:28,806 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:28,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46759,1676502088438}] 2023-02-15 23:01:28,960 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:28,960 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:28,962 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41900, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:28,966 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 23:01:28,966 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:28,967 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46759%2C1676502088438.meta, suffix=.meta, logDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/WALs/jenkins-hbase4.apache.org,46759,1676502088438, archiveDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/oldWALs, maxLogs=32 2023-02-15 23:01:28,983 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43699,DS-e9357892-434b-4fa7-a536-85514e48eef0,DISK] 2023-02-15 23:01:28,983 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46591,DS-307b6cc1-56ca-4fa0-8ece-389d80e93c16,DISK] 2023-02-15 23:01:28,986 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/WALs/jenkins-hbase4.apache.org,46759,1676502088438/jenkins-hbase4.apache.org%2C46759%2C1676502088438.meta.1676502088968.meta 2023-02-15 23:01:28,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43699,DS-e9357892-434b-4fa7-a536-85514e48eef0,DISK], DatanodeInfoWithStorage[127.0.0.1:46591,DS-307b6cc1-56ca-4fa0-8ece-389d80e93c16,DISK]] 2023-02-15 23:01:28,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:28,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 23:01:28,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 23:01:28,987 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 23:01:28,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 23:01:28,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:28,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 23:01:28,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 23:01:28,989 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:28,990 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/info 2023-02-15 23:01:28,990 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/info 2023-02-15 23:01:28,990 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:28,991 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:28,991 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:28,991 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:28,992 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:28,992 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:28,992 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:28,992 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:28,993 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/table 2023-02-15 23:01:28,993 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/table 2023-02-15 23:01:28,993 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:28,994 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:28,995 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740 2023-02-15 23:01:28,996 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740 2023-02-15 23:01:28,997 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:28,998 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:28,999 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62681657, jitterRate=-0.0659705251455307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:28,999 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:29,000 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676502088960 2023-02-15 23:01:29,003 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 23:01:29,004 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 23:01:29,004 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46759,1676502088438, state=OPEN 2023-02-15 23:01:29,005 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 23:01:29,005 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:29,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 23:01:29,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46759,1676502088438 in 199 msec 2023-02-15 23:01:29,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 23:01:29,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 360 msec 2023-02-15 23:01:29,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 407 msec 2023-02-15 23:01:29,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676502089010, completionTime=-1 2023-02-15 23:01:29,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 23:01:29,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 23:01:29,014 DEBUG [hconnection-0x1dc988a9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:29,015 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41902, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:29,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 23:01:29,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676502149016 2023-02-15 23:01:29,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676502209017 2023-02-15 23:01:29,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-15 23:01:29,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32933,1676502088351-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:29,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32933,1676502088351-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:29,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32933,1676502088351-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:29,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:32933, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:29,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:29,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 23:01:29,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:29,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 23:01:29,027 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 23:01:29,027 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:29,028 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:29,029 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/hbase/namespace/993696061a2aef1471a25e4819830845 2023-02-15 23:01:29,030 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/hbase/namespace/993696061a2aef1471a25e4819830845 empty. 2023-02-15 23:01:29,030 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/hbase/namespace/993696061a2aef1471a25e4819830845 2023-02-15 23:01:29,030 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 23:01:29,044 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:29,045 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 993696061a2aef1471a25e4819830845, NAME => 'hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp 2023-02-15 23:01:29,053 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:29,054 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 993696061a2aef1471a25e4819830845, disabling compactions & flushes 2023-02-15 23:01:29,054 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. 2023-02-15 23:01:29,054 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. 2023-02-15 23:01:29,054 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. after waiting 0 ms 2023-02-15 23:01:29,054 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. 2023-02-15 23:01:29,054 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. 2023-02-15 23:01:29,054 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 993696061a2aef1471a25e4819830845: 2023-02-15 23:01:29,056 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:29,057 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502089057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502089057"}]},"ts":"1676502089057"} 2023-02-15 23:01:29,059 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 23:01:29,060 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:29,060 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502089060"}]},"ts":"1676502089060"} 2023-02-15 23:01:29,061 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 23:01:29,064 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:29,065 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:29,065 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:29,065 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:29,065 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=993696061a2aef1471a25e4819830845, ASSIGN}] 2023-02-15 23:01:29,067 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=993696061a2aef1471a25e4819830845, ASSIGN 2023-02-15 23:01:29,068 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=993696061a2aef1471a25e4819830845, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39295,1676502088408; forceNewPlan=false, retain=false 2023-02-15 23:01:29,218 INFO [jenkins-hbase4:32933] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 23:01:29,219 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=993696061a2aef1471a25e4819830845, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:29,219 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502089219"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502089219"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502089219"}]},"ts":"1676502089219"} 2023-02-15 23:01:29,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 993696061a2aef1471a25e4819830845, server=jenkins-hbase4.apache.org,39295,1676502088408}] 2023-02-15 23:01:29,373 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:29,373 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:29,375 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48638, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:29,380 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. 2023-02-15 23:01:29,382 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39295%2C1676502088408, suffix=, logDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/WALs/jenkins-hbase4.apache.org,39295,1676502088408, archiveDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/oldWALs, maxLogs=32 2023-02-15 23:01:29,395 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43699,DS-e9357892-434b-4fa7-a536-85514e48eef0,DISK] 2023-02-15 23:01:29,396 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46591,DS-307b6cc1-56ca-4fa0-8ece-389d80e93c16,DISK] 2023-02-15 23:01:29,398 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/WALs/jenkins-hbase4.apache.org,39295,1676502088408/jenkins-hbase4.apache.org%2C39295%2C1676502088408.1676502089382 2023-02-15 23:01:29,398 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43699,DS-e9357892-434b-4fa7-a536-85514e48eef0,DISK], DatanodeInfoWithStorage[127.0.0.1:46591,DS-307b6cc1-56ca-4fa0-8ece-389d80e93c16,DISK]] 2023-02-15 23:01:29,398 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 993696061a2aef1471a25e4819830845, NAME => 'hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:29,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 993696061a2aef1471a25e4819830845 2023-02-15 23:01:29,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:29,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 993696061a2aef1471a25e4819830845 2023-02-15 23:01:29,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 993696061a2aef1471a25e4819830845 2023-02-15 23:01:29,401 INFO [StoreOpener-993696061a2aef1471a25e4819830845-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 993696061a2aef1471a25e4819830845 2023-02-15 23:01:29,402 DEBUG [StoreOpener-993696061a2aef1471a25e4819830845-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/namespace/993696061a2aef1471a25e4819830845/info 2023-02-15 23:01:29,402 DEBUG [StoreOpener-993696061a2aef1471a25e4819830845-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/namespace/993696061a2aef1471a25e4819830845/info 2023-02-15 23:01:29,403 INFO [StoreOpener-993696061a2aef1471a25e4819830845-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 993696061a2aef1471a25e4819830845 columnFamilyName info 2023-02-15 23:01:29,403 INFO [StoreOpener-993696061a2aef1471a25e4819830845-1] regionserver.HStore(310): Store=993696061a2aef1471a25e4819830845/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:29,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/namespace/993696061a2aef1471a25e4819830845 2023-02-15 23:01:29,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/namespace/993696061a2aef1471a25e4819830845 2023-02-15 23:01:29,406 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 993696061a2aef1471a25e4819830845 2023-02-15 23:01:29,407 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/namespace/993696061a2aef1471a25e4819830845/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:29,408 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 993696061a2aef1471a25e4819830845; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67786627, jitterRate=0.010099455714225769}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:29,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 993696061a2aef1471a25e4819830845: 2023-02-15 23:01:29,409 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845., pid=6, masterSystemTime=1676502089373 2023-02-15 23:01:29,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. 2023-02-15 23:01:29,412 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. 2023-02-15 23:01:29,412 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=993696061a2aef1471a25e4819830845, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:29,413 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502089412"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502089412"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502089412"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502089412"}]},"ts":"1676502089412"} 2023-02-15 23:01:29,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 23:01:29,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 993696061a2aef1471a25e4819830845, server=jenkins-hbase4.apache.org,39295,1676502088408 in 193 msec 2023-02-15 23:01:29,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 23:01:29,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=993696061a2aef1471a25e4819830845, ASSIGN in 350 msec 2023-02-15 23:01:29,417 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:29,418 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502089417"}]},"ts":"1676502089417"} 2023-02-15 23:01:29,419 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 23:01:29,421 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:29,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 396 msec 2023-02-15 23:01:29,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 23:01:29,429 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:29,429 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:29,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:29,433 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48654, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:29,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 23:01:29,442 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:29,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-15 23:01:29,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 23:01:29,463 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:29,467 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-15 23:01:29,471 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 23:01:29,474 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 23:01:29,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.005sec 2023-02-15 23:01:29,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 23:01:29,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 23:01:29,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 23:01:29,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32933,1676502088351-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 23:01:29,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32933,1676502088351-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 23:01:29,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 23:01:29,563 DEBUG [Listener at localhost/39971] zookeeper.ReadOnlyZKClient(139): Connect 0x4b196302 to 127.0.0.1:57163 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:29,569 DEBUG [Listener at localhost/39971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f120b64, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:29,570 DEBUG [hconnection-0x401eae02-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:29,572 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41912, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:29,574 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,32933,1676502088351 2023-02-15 23:01:29,574 DEBUG [Listener at localhost/39971] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 23:01:29,576 DEBUG [Listener at localhost/39971] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 23:01:29,578 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35026, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 23:01:29,578 INFO [Listener at localhost/39971] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:29,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:29,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 23:01:29,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 97 connection: 172.31.14.131:35026 deadline: 1676502149578, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:29,579 INFO [Listener at localhost/39971] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-15 23:01:29,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:29,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:29,584 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:29,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-15 23:01:29,585 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:29,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:29,586 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:29,587 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd empty. 2023-02-15 23:01:29,587 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:29,587 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-15 23:01:29,596 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:29,597 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5b9b00a9eb67179f73982d0ec50a86dd, NAME => 'testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp 2023-02-15 23:01:29,606 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:29,606 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 5b9b00a9eb67179f73982d0ec50a86dd, disabling compactions & flushes 2023-02-15 23:01:29,606 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:29,606 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:29,606 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. after waiting 0 ms 2023-02-15 23:01:29,606 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:29,607 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:29,607 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 5b9b00a9eb67179f73982d0ec50a86dd: 2023-02-15 23:01:29,609 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:29,610 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676502089609"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502089609"}]},"ts":"1676502089609"} 2023-02-15 23:01:29,611 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 23:01:29,612 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:29,612 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502089612"}]},"ts":"1676502089612"} 2023-02-15 23:01:29,614 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-15 23:01:29,617 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:29,618 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:29,618 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:29,618 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:29,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5b9b00a9eb67179f73982d0ec50a86dd, ASSIGN}] 2023-02-15 23:01:29,620 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5b9b00a9eb67179f73982d0ec50a86dd, ASSIGN 2023-02-15 23:01:29,621 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5b9b00a9eb67179f73982d0ec50a86dd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46759,1676502088438; forceNewPlan=false, retain=false 2023-02-15 23:01:29,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:29,747 INFO [RS:1;jenkins-hbase4:46759] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46759%2C1676502088438, suffix=, logDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/WALs/jenkins-hbase4.apache.org,46759,1676502088438, archiveDir=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/oldWALs, maxLogs=32 2023-02-15 23:01:29,761 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43699,DS-e9357892-434b-4fa7-a536-85514e48eef0,DISK] 2023-02-15 23:01:29,762 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46591,DS-307b6cc1-56ca-4fa0-8ece-389d80e93c16,DISK] 2023-02-15 23:01:29,765 INFO [RS:1;jenkins-hbase4:46759] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/WALs/jenkins-hbase4.apache.org,46759,1676502088438/jenkins-hbase4.apache.org%2C46759%2C1676502088438.1676502089747 2023-02-15 23:01:29,765 DEBUG [RS:1;jenkins-hbase4:46759] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43699,DS-e9357892-434b-4fa7-a536-85514e48eef0,DISK], DatanodeInfoWithStorage[127.0.0.1:46591,DS-307b6cc1-56ca-4fa0-8ece-389d80e93c16,DISK]] 2023-02-15 23:01:29,771 INFO [jenkins-hbase4:32933] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 23:01:29,772 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5b9b00a9eb67179f73982d0ec50a86dd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:29,772 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676502089772"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502089772"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502089772"}]},"ts":"1676502089772"} 2023-02-15 23:01:29,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 5b9b00a9eb67179f73982d0ec50a86dd, server=jenkins-hbase4.apache.org,46759,1676502088438}] 2023-02-15 23:01:29,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:29,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:29,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5b9b00a9eb67179f73982d0ec50a86dd, NAME => 'testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:29,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:29,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:29,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:29,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:29,930 INFO [StoreOpener-5b9b00a9eb67179f73982d0ec50a86dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:29,931 DEBUG [StoreOpener-5b9b00a9eb67179f73982d0ec50a86dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f1 2023-02-15 23:01:29,931 DEBUG [StoreOpener-5b9b00a9eb67179f73982d0ec50a86dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f1 2023-02-15 23:01:29,932 INFO [StoreOpener-5b9b00a9eb67179f73982d0ec50a86dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b9b00a9eb67179f73982d0ec50a86dd columnFamilyName f1 2023-02-15 23:01:29,932 INFO [StoreOpener-5b9b00a9eb67179f73982d0ec50a86dd-1] regionserver.HStore(310): Store=5b9b00a9eb67179f73982d0ec50a86dd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:29,932 INFO [StoreOpener-5b9b00a9eb67179f73982d0ec50a86dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:29,933 DEBUG [StoreOpener-5b9b00a9eb67179f73982d0ec50a86dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f2 2023-02-15 23:01:29,933 DEBUG [StoreOpener-5b9b00a9eb67179f73982d0ec50a86dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f2 2023-02-15 23:01:29,934 INFO [StoreOpener-5b9b00a9eb67179f73982d0ec50a86dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b9b00a9eb67179f73982d0ec50a86dd columnFamilyName f2 2023-02-15 23:01:29,934 INFO [StoreOpener-5b9b00a9eb67179f73982d0ec50a86dd-1] regionserver.HStore(310): Store=5b9b00a9eb67179f73982d0ec50a86dd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:29,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:29,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:29,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:29,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:29,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:29,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5b9b00a9eb67179f73982d0ec50a86dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70180145, jitterRate=0.045765653252601624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:29,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5b9b00a9eb67179f73982d0ec50a86dd: 2023-02-15 23:01:29,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd., pid=12, masterSystemTime=1676502089925 2023-02-15 23:01:29,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:29,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:29,942 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5b9b00a9eb67179f73982d0ec50a86dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:29,943 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676502089942"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502089942"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502089942"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502089942"}]},"ts":"1676502089942"} 2023-02-15 23:01:29,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 23:01:29,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 5b9b00a9eb67179f73982d0ec50a86dd, server=jenkins-hbase4.apache.org,46759,1676502088438 in 171 msec 2023-02-15 23:01:29,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 23:01:29,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5b9b00a9eb67179f73982d0ec50a86dd, ASSIGN in 328 msec 2023-02-15 23:01:29,948 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:29,948 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502089948"}]},"ts":"1676502089948"} 2023-02-15 23:01:29,949 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-15 23:01:29,952 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:29,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 370 msec 2023-02-15 23:01:30,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:30,191 INFO [Listener at localhost/39971] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-15 23:01:30,191 DEBUG [Listener at localhost/39971] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-15 23:01:30,191 INFO [Listener at localhost/39971] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:30,193 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-15 23:01:30,194 INFO [Listener at localhost/39971] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:30,194 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-15 23:01:30,194 INFO [Listener at localhost/39971] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 23:01:30,648 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46759] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:30,751 INFO [Listener at localhost/39971] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 23:01:30,752 INFO [Listener at localhost/39971] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 23:01:30,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-15 23:01:30,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676502090753 (current time:1676502090753). 2023-02-15 23:01:30,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 23:01:30,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] zookeeper.ReadOnlyZKClient(139): Connect 0x330807e9 to 127.0.0.1:57163 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:30,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61bce38a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:30,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:30,762 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41922, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:30,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x330807e9 to 127.0.0.1:57163 2023-02-15 23:01:30,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:30,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 23:01:30,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-15 23:01:30,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-15 23:01:30,767 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-15 23:01:30,768 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676502690768 2023-02-15 23:01:30,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-15 23:01:30,768 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:30,770 DEBUG [Listener at localhost/39971] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:30,770 DEBUG [Listener at localhost/39971] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 23:01:30,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-15 23:01:30,771 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-15 23:01:30,772 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 6 msec 2023-02-15 23:01:30,772 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-15 23:01:30,774 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676502690774 2023-02-15 23:01:30,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-15 23:01:30,785 INFO [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-15 23:01:30,785 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:30,786 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-15 23:01:30,786 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-15 23:01:30,786 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,787 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-15 23:01:30,788 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:30,788 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:30,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:30,788 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:30,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:30,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:30,788 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 23:01:30,788 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:30,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 23:01:30,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-15 23:01:30,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 23:01:30,789 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-15 23:01:30,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-15 23:01:30,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 23:01:30,789 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-15 23:01:30,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 23:01:30,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 23:01:30,789 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 23:01:30,789 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:30,790 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 23:01:30,790 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 23:01:30,790 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46759,1676502088438' joining acquired barrier for procedure (foo) in zk 2023-02-15 23:01:30,790 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 23:01:30,790 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:30,791 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 23:01:30,791 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 23:01:30,791 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39295,1676502088408' joining acquired barrier for procedure (foo) in zk 2023-02-15 23:01:30,793 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:30,793 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:30,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:30,794 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:30,794 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 23:01:30,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:30,794 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:30,794 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 23:01:30,794 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:30,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:30,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 23:01:30,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:30,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:30,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46759,1676502088438' joining acquired barrier for procedure 'foo' on coordinator 2023-02-15 23:01:30,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ef41614[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:30,796 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-15 23:01:30,796 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:30,797 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 23:01:30,797 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 23:01:30,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:30,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:30,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:30,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:30,797 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 23:01:30,797 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 23:01:30,798 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 23:01:30,798 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,39295,1676502088408' in zk 2023-02-15 23:01:30,798 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,798 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:30,798 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 23:01:30,798 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 23:01:30,798 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:30,798 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. started... 2023-02-15 23:01:30,799 INFO [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5b9b00a9eb67179f73982d0ec50a86dd 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 23:01:30,800 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 23:01:30,800 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:30,800 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 23:01:30,816 INFO [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/.tmp/f1/d7f936db693245199b92973ad033170a 2023-02-15 23:01:30,835 INFO [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/.tmp/f2/ab66711177304ac289e732466df5e6c0 2023-02-15 23:01:30,840 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/.tmp/f1/d7f936db693245199b92973ad033170a as hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f1/d7f936db693245199b92973ad033170a 2023-02-15 23:01:30,843 INFO [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f1/d7f936db693245199b92973ad033170a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 23:01:30,844 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/.tmp/f2/ab66711177304ac289e732466df5e6c0 as hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f2/ab66711177304ac289e732466df5e6c0 2023-02-15 23:01:30,849 INFO [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f2/ab66711177304ac289e732466df5e6c0, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 23:01:30,850 INFO [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 5b9b00a9eb67179f73982d0ec50a86dd in 51ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:30,850 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-15 23:01:30,850 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5b9b00a9eb67179f73982d0ec50a86dd: 2023-02-15 23:01:30,850 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.' region-info for snapshot=foo 2023-02-15 23:01:30,851 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:30,851 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f1/d7f936db693245199b92973ad033170a] hfiles 2023-02-15 23:01:30,851 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f1/d7f936db693245199b92973ad033170a for snapshot=foo 2023-02-15 23:01:30,851 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f2/ab66711177304ac289e732466df5e6c0] hfiles 2023-02-15 23:01:30,851 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f2/ab66711177304ac289e732466df5e6c0 for snapshot=foo 2023-02-15 23:01:30,857 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. completed. 2023-02-15 23:01:30,857 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:30,857 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 23:01:30,857 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 23:01:30,857 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,857 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 23:01:30,857 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,46759,1676502088438' in zk 2023-02-15 23:01:30,860 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 23:01:30,860 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,860 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:30,860 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 23:01:30,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:30,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:30,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:30,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:30,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 23:01:30,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:30,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:30,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 23:01:30,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:30,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,46759,1676502088438': 2023-02-15 23:01:30,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46759,1676502088438' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-15 23:01:30,864 INFO [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-15 23:01:30,864 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:30,864 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:30,864 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-15 23:01:30,864 INFO [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 23:01:30,867 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,867 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,868 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,868 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:30,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,867 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:30,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:30,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:30,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:30,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:30,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:30,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:30,868 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:30,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,869 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:30,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 23:01:30,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:30,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 23:01:30,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,870 DEBUG [Listener at localhost/39971] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:30,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:30,871 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:30,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-15 23:01:30,871 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:30,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-15 23:01:30,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 23:01:30,872 DEBUG [Listener at localhost/39971] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 23:01:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:30,877 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:30,877 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:30,877 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:30,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:30,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:30,877 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 23:01:30,877 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:30,877 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-15 23:01:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:30,877 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:30,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-15 23:01:30,877 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:30,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:30,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:30,877 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,879 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 23:01:30,879 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:30,879 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 23:01:30,879 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:30,879 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 23:01:30,879 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 23:01:30,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.hbase-snapshot/.tmp/foo 2023-02-15 23:01:30,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:30,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:30,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.hbase-snapshot/.tmp/foo to hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.hbase-snapshot/foo 2023-02-15 23:01:30,918 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-15 23:01:30,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.hbase-snapshot/.tmp/foo 2023-02-15 23:01:30,919 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.hbase-snapshot/.tmp/foo 2023-02-15 23:01:30,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676502090768Consolidate snapshot: foo at 1676502090878 (+110 ms)Loading Region manifests for foo at 1676502090878Writing data manifest for foo at 1676502090882 (+4 ms)Verifying snapshot: foo at 1676502090895 (+13 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676502090918 (+23 ms) 2023-02-15 23:01:30,920 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-15 23:01:30,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 151 msec 2023-02-15 23:01:31,072 DEBUG [Listener at localhost/39971] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:31,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-15 23:01:31,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 23:01:31,074 INFO [Listener at localhost/39971] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 23:01:31,078 INFO [Listener at localhost/39971] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 23:01:31,084 INFO [Listener at localhost/39971] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 23:01:31,458 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46759] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:31,547 INFO [Listener at localhost/39971] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 23:01:31,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 23:01:31,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,557 INFO [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-15 23:01:31,557 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:31,558 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-15 23:01:31,558 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-15 23:01:31,559 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,559 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,561 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:31,561 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:31,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:31,561 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:31,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:31,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:31,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,562 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,562 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:31,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:31,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:31,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,563 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,563 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,563 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,563 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,566 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-15 23:01:31,566 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:31,566 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-15 23:01:31,567 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-15 23:01:31,567 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-15 23:01:31,567 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:31,567 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39295,1676502088408' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-15 23:01:31,568 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-15 23:01:31,568 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 23:01:31,568 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 23:01:31,568 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:31,568 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. started... 2023-02-15 23:01:31,569 INFO [rs(jenkins-hbase4.apache.org,46759,1676502088438)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5b9b00a9eb67179f73982d0ec50a86dd 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 23:01:31,570 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,570 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,570 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:31,588 INFO [rs(jenkins-hbase4.apache.org,46759,1676502088438)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/.tmp/f1/4d37105ab60a4158bb09518175d92dd0 2023-02-15 23:01:31,611 INFO [rs(jenkins-hbase4.apache.org,46759,1676502088438)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/.tmp/f2/9fed36e5519547edb84f764a86ab6ea3 2023-02-15 23:01:31,616 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/.tmp/f1/4d37105ab60a4158bb09518175d92dd0 as hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f1/4d37105ab60a4158bb09518175d92dd0 2023-02-15 23:01:31,620 INFO [rs(jenkins-hbase4.apache.org,46759,1676502088438)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f1/4d37105ab60a4158bb09518175d92dd0, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 23:01:31,621 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/.tmp/f2/9fed36e5519547edb84f764a86ab6ea3 as hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f2/9fed36e5519547edb84f764a86ab6ea3 2023-02-15 23:01:31,626 INFO [rs(jenkins-hbase4.apache.org,46759,1676502088438)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f2/9fed36e5519547edb84f764a86ab6ea3, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 23:01:31,627 INFO [rs(jenkins-hbase4.apache.org,46759,1676502088438)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 5b9b00a9eb67179f73982d0ec50a86dd in 58ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:31,628 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5b9b00a9eb67179f73982d0ec50a86dd: 2023-02-15 23:01:31,628 DEBUG [rs(jenkins-hbase4.apache.org,46759,1676502088438)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:31,628 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 23:01:31,628 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 23:01:31,628 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,628 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-15 23:01:31,628 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46759,1676502088438' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-15 23:01:31,632 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,632 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:31,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:31,632 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,632 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:31,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:31,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:31,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:31,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:31,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46759,1676502088438' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-15 23:01:31,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@acb9312[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:31,634 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-15 23:01:31,634 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,635 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,635 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-15 23:01:31,636 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,636 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-15 23:01:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-15 23:01:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-15 23:01:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,39295,1676502088408' in zk 2023-02-15 23:01:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,46759,1676502088438' in zk 2023-02-15 23:01:31,637 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-15 23:01:31,637 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-15 23:01:31,637 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,637 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:31,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:31,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:31,637 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:31,637 DEBUG [member: 'jenkins-hbase4.apache.org,39295,1676502088408' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-15 23:01:31,638 DEBUG [member: 'jenkins-hbase4.apache.org,46759,1676502088438' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-15 23:01:31,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:31,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:31,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:31,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:31,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:31,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,46759,1676502088438': 2023-02-15 23:01:31,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46759,1676502088438' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-15 23:01:31,642 INFO [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-15 23:01:31,642 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:31,642 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:31,642 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,642 INFO [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 23:01:31,643 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,643 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:31,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:31,643 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,643 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:31,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,644 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:31,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:31,644 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:31,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:31,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:31,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:31,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,644 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:31,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:31,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:31,646 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:31,646 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:31,650 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:31,650 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:31,650 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:31,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:31,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:31,650 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:31,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:31,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-15 23:01:31,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 23:01:31,650 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:31,650 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:31,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:31,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:31,650 DEBUG [(jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:31,650 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,651 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,651 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:31,651 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,651 DEBUG [Listener at localhost/39971] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:31,651 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,651 DEBUG [Listener at localhost/39971] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 23:01:31,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:31,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:31,651 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,652 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,752 DEBUG [Listener at localhost/39971] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 23:01:31,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 23:01:31,757 INFO [Listener at localhost/39971] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676502090753 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:31,757 DEBUG [Listener at localhost/39971] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:32913/user/jenkins/test-data/f39d96ed-f87c-c829-01b5-e8089a3745c5/foo/09e65fb1-d954-445f-adb8-daa20f968be0/data/default/testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,758 INFO [Listener at localhost/39971] snapshot.RestoreSnapshotHelper(239): region to add: 5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:31,758 INFO [Listener at localhost/39971] snapshot.RestoreSnapshotHelper(585): clone region=5b9b00a9eb67179f73982d0ec50a86dd as 5b9b00a9eb67179f73982d0ec50a86dd in snapshot foo 2023-02-15 23:01:31,759 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5b9b00a9eb67179f73982d0ec50a86dd, NAME => 'testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32913/user/jenkins/test-data/f39d96ed-f87c-c829-01b5-e8089a3745c5/foo/09e65fb1-d954-445f-adb8-daa20f968be0 2023-02-15 23:01:31,765 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:31,765 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d7f936db693245199b92973ad033170a from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,767 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ab66711177304ac289e732466df5e6c0 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,769 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 5b9b00a9eb67179f73982d0ec50a86dd, disabling compactions & flushes 2023-02-15 23:01:31,769 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:31,769 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:31,769 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. after waiting 0 ms 2023-02-15 23:01:31,769 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:31,769 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:31,769 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 5b9b00a9eb67179f73982d0ec50a86dd: 2023-02-15 23:01:31,769 INFO [Listener at localhost/39971] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676502090753 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:31,769 DEBUG [Listener at localhost/39971] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:32913/user/jenkins/test-data/f39d96ed-f87c-c829-01b5-e8089a3745c5/foo/09e65fb1-d954-445f-adb8-daa20f968be0 2023-02-15 23:01:31,769 DEBUG [Listener at localhost/39971] util.CommonFSUtils(682): File system contents for path hdfs://localhost:32913/user/jenkins/test-data/f39d96ed-f87c-c829-01b5-e8089a3745c5/foo/09e65fb1-d954-445f-adb8-daa20f968be0 2023-02-15 23:01:31,769 DEBUG [Listener at localhost/39971] util.CommonFSUtils(699): |-data/ 2023-02-15 23:01:31,770 DEBUG [Listener at localhost/39971] util.CommonFSUtils(699): |----default/ 2023-02-15 23:01:31,770 DEBUG [Listener at localhost/39971] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-15 23:01:31,771 DEBUG [Listener at localhost/39971] util.CommonFSUtils(699): |----------5b9b00a9eb67179f73982d0ec50a86dd/ 2023-02-15 23:01:31,771 DEBUG [Listener at localhost/39971] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:31,771 DEBUG [Listener at localhost/39971] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:31,772 DEBUG [Listener at localhost/39971] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=5b9b00a9eb67179f73982d0ec50a86dd-d7f936db693245199b92973ad033170a 2023-02-15 23:01:31,772 DEBUG [Listener at localhost/39971] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:31,772 DEBUG [Listener at localhost/39971] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=5b9b00a9eb67179f73982d0ec50a86dd-ab66711177304ac289e732466df5e6c0 2023-02-15 23:01:31,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-15 23:01:31,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-15 23:01:31,776 INFO [Listener at localhost/39971] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:31,780 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502091780"}]},"ts":"1676502091780"} 2023-02-15 23:01:31,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 23:01:31,781 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-15 23:01:31,783 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-15 23:01:31,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5b9b00a9eb67179f73982d0ec50a86dd, UNASSIGN}] 2023-02-15 23:01:31,785 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5b9b00a9eb67179f73982d0ec50a86dd, UNASSIGN 2023-02-15 23:01:31,785 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5b9b00a9eb67179f73982d0ec50a86dd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:31,785 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676502091785"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502091785"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502091785"}]},"ts":"1676502091785"} 2023-02-15 23:01:31,787 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 5b9b00a9eb67179f73982d0ec50a86dd, server=jenkins-hbase4.apache.org,46759,1676502088438}] 2023-02-15 23:01:31,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 23:01:31,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:31,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5b9b00a9eb67179f73982d0ec50a86dd, disabling compactions & flushes 2023-02-15 23:01:31,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:31,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:31,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. after waiting 0 ms 2023-02-15 23:01:31,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:31,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:31,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd. 2023-02-15 23:01:31,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5b9b00a9eb67179f73982d0ec50a86dd: 2023-02-15 23:01:31,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:31,945 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5b9b00a9eb67179f73982d0ec50a86dd, regionState=CLOSED 2023-02-15 23:01:31,945 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676502091945"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502091945"}]},"ts":"1676502091945"} 2023-02-15 23:01:31,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 23:01:31,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 5b9b00a9eb67179f73982d0ec50a86dd, server=jenkins-hbase4.apache.org,46759,1676502088438 in 159 msec 2023-02-15 23:01:31,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 23:01:31,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=5b9b00a9eb67179f73982d0ec50a86dd, UNASSIGN in 164 msec 2023-02-15 23:01:31,949 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502091949"}]},"ts":"1676502091949"} 2023-02-15 23:01:31,950 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-15 23:01:31,951 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-15 23:01:31,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 175 msec 2023-02-15 23:01:32,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 23:01:32,083 INFO [Listener at localhost/39971] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-15 23:01:32,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:32,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:32,086 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:32,087 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:32,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 23:01:32,091 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:32,092 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f1, FileablePath, hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f2, FileablePath, hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/recovered.edits] 2023-02-15 23:01:32,096 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f1/4d37105ab60a4158bb09518175d92dd0 to hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/archive/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f1/4d37105ab60a4158bb09518175d92dd0 2023-02-15 23:01:32,097 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f1/d7f936db693245199b92973ad033170a to hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/archive/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f1/d7f936db693245199b92973ad033170a 2023-02-15 23:01:32,100 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f2/9fed36e5519547edb84f764a86ab6ea3 to hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/archive/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f2/9fed36e5519547edb84f764a86ab6ea3 2023-02-15 23:01:32,101 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f2/ab66711177304ac289e732466df5e6c0 to hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/archive/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/f2/ab66711177304ac289e732466df5e6c0 2023-02-15 23:01:32,103 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/recovered.edits/12.seqid to hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/archive/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd/recovered.edits/12.seqid 2023-02-15 23:01:32,104 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/.tmp/data/default/testInitTableSnapshotMapperJobConfig/5b9b00a9eb67179f73982d0ec50a86dd 2023-02-15 23:01:32,104 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-15 23:01:32,106 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:32,108 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-15 23:01:32,110 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-15 23:01:32,111 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:32,111 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-15 23:01:32,111 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502092111"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:32,112 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 23:01:32,112 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5b9b00a9eb67179f73982d0ec50a86dd, NAME => 'testInitTableSnapshotMapperJobConfig,,1676502089581.5b9b00a9eb67179f73982d0ec50a86dd.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 23:01:32,113 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-15 23:01:32,113 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676502092113"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:32,116 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-15 23:01:32,118 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 23:01:32,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 34 msec 2023-02-15 23:01:32,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32933] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 23:01:32,189 INFO [Listener at localhost/39971] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-15 23:01:32,189 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 23:01:32,189 INFO [Listener at localhost/39971] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 23:01:32,190 DEBUG [Listener at localhost/39971] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b196302 to 127.0.0.1:57163 2023-02-15 23:01:32,190 DEBUG [Listener at localhost/39971] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:32,190 DEBUG [Listener at localhost/39971] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 23:01:32,190 DEBUG [Listener at localhost/39971] util.JVMClusterUtil(257): Found active master hash=796517834, stopped=false 2023-02-15 23:01:32,190 INFO [Listener at localhost/39971] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,32933,1676502088351 2023-02-15 23:01:32,193 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:32,193 INFO [Listener at localhost/39971] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 23:01:32,193 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:32,193 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:32,193 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:32,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:32,195 DEBUG [Listener at localhost/39971] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49a31c6c to 127.0.0.1:57163 2023-02-15 23:01:32,195 DEBUG [Listener at localhost/39971] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:32,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:32,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:32,195 INFO [Listener at localhost/39971] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39295,1676502088408' ***** 2023-02-15 23:01:32,196 INFO [Listener at localhost/39971] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:32,196 INFO [Listener at localhost/39971] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46759,1676502088438' ***** 2023-02-15 23:01:32,196 INFO [Listener at localhost/39971] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:32,196 INFO [RS:0;jenkins-hbase4:39295] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:32,196 INFO [RS:0;jenkins-hbase4:39295] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:32,196 INFO [RS:0;jenkins-hbase4:39295] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:32,196 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:32,196 INFO [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(3304): Received CLOSE for 993696061a2aef1471a25e4819830845 2023-02-15 23:01:32,196 INFO [RS:1;jenkins-hbase4:46759] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:32,197 INFO [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:32,197 INFO [RS:1;jenkins-hbase4:46759] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:32,197 DEBUG [RS:0;jenkins-hbase4:39295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62d0295b to 127.0.0.1:57163 2023-02-15 23:01:32,197 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:32,198 DEBUG [RS:0;jenkins-hbase4:39295] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:32,197 INFO [RS:1;jenkins-hbase4:46759] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:32,198 INFO [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 23:01:32,198 INFO [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:32,198 DEBUG [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(1479): Online Regions={993696061a2aef1471a25e4819830845=hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845.} 2023-02-15 23:01:32,198 DEBUG [RS:1;jenkins-hbase4:46759] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d6a9167 to 127.0.0.1:57163 2023-02-15 23:01:32,198 DEBUG [RS:1;jenkins-hbase4:46759] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:32,198 DEBUG [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(1505): Waiting on 993696061a2aef1471a25e4819830845 2023-02-15 23:01:32,198 INFO [RS:1;jenkins-hbase4:46759] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:32,199 INFO [RS:1;jenkins-hbase4:46759] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:32,199 INFO [RS:1;jenkins-hbase4:46759] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:32,200 INFO [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 23:01:32,200 INFO [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 23:01:32,200 DEBUG [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-15 23:01:32,200 DEBUG [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 23:01:32,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 993696061a2aef1471a25e4819830845, disabling compactions & flushes 2023-02-15 23:01:32,202 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:32,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. 2023-02-15 23:01:32,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:32,202 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:32,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. 2023-02-15 23:01:32,202 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:32,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. after waiting 0 ms 2023-02-15 23:01:32,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. 2023-02-15 23:01:32,202 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:32,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 993696061a2aef1471a25e4819830845 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 23:01:32,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-15 23:01:32,223 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/.tmp/info/9c0dcf5cdbd84e2cbe0e7336c14c1338 2023-02-15 23:01:32,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/namespace/993696061a2aef1471a25e4819830845/.tmp/info/c1e14bf7b3e34a1fa3238214f08afaeb 2023-02-15 23:01:32,227 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:32,227 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:32,229 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c0dcf5cdbd84e2cbe0e7336c14c1338 2023-02-15 23:01:32,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/namespace/993696061a2aef1471a25e4819830845/.tmp/info/c1e14bf7b3e34a1fa3238214f08afaeb as hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/namespace/993696061a2aef1471a25e4819830845/info/c1e14bf7b3e34a1fa3238214f08afaeb 2023-02-15 23:01:32,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/namespace/993696061a2aef1471a25e4819830845/info/c1e14bf7b3e34a1fa3238214f08afaeb, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 23:01:32,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 993696061a2aef1471a25e4819830845 in 35ms, sequenceid=6, compaction requested=false 2023-02-15 23:01:32,237 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/.tmp/rep_barrier/c927d3180f5348f29bf1e71dc0d32a56 2023-02-15 23:01:32,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/namespace/993696061a2aef1471a25e4819830845/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 23:01:32,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. 2023-02-15 23:01:32,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 993696061a2aef1471a25e4819830845: 2023-02-15 23:01:32,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676502089025.993696061a2aef1471a25e4819830845. 2023-02-15 23:01:32,241 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c927d3180f5348f29bf1e71dc0d32a56 2023-02-15 23:01:32,252 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/.tmp/table/c96969ef286b48929c635c6ad9a5bb0e 2023-02-15 23:01:32,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c96969ef286b48929c635c6ad9a5bb0e 2023-02-15 23:01:32,256 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/.tmp/info/9c0dcf5cdbd84e2cbe0e7336c14c1338 as hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/info/9c0dcf5cdbd84e2cbe0e7336c14c1338 2023-02-15 23:01:32,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c0dcf5cdbd84e2cbe0e7336c14c1338 2023-02-15 23:01:32,261 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/info/9c0dcf5cdbd84e2cbe0e7336c14c1338, entries=12, sequenceid=21, filesize=6.3 K 2023-02-15 23:01:32,261 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/.tmp/rep_barrier/c927d3180f5348f29bf1e71dc0d32a56 as hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/rep_barrier/c927d3180f5348f29bf1e71dc0d32a56 2023-02-15 23:01:32,265 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c927d3180f5348f29bf1e71dc0d32a56 2023-02-15 23:01:32,265 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/rep_barrier/c927d3180f5348f29bf1e71dc0d32a56, entries=1, sequenceid=21, filesize=5.0 K 2023-02-15 23:01:32,266 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/.tmp/table/c96969ef286b48929c635c6ad9a5bb0e as hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/table/c96969ef286b48929c635c6ad9a5bb0e 2023-02-15 23:01:32,270 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c96969ef286b48929c635c6ad9a5bb0e 2023-02-15 23:01:32,270 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/table/c96969ef286b48929c635c6ad9a5bb0e, entries=4, sequenceid=21, filesize=5.1 K 2023-02-15 23:01:32,271 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 69ms, sequenceid=21, compaction requested=false 2023-02-15 23:01:32,275 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 23:01:32,276 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 23:01:32,276 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:32,276 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:32,276 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:32,398 INFO [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39295,1676502088408; all regions closed. 2023-02-15 23:01:32,400 INFO [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46759,1676502088438; all regions closed. 2023-02-15 23:01:32,402 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/WALs/jenkins-hbase4.apache.org,39295,1676502088408/jenkins-hbase4.apache.org%2C39295%2C1676502088408.1676502089382 not finished, retry = 0 2023-02-15 23:01:32,405 DEBUG [RS:1;jenkins-hbase4:46759] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/oldWALs 2023-02-15 23:01:32,405 INFO [RS:1;jenkins-hbase4:46759] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46759%2C1676502088438.meta:.meta(num 1676502088968) 2023-02-15 23:01:32,409 DEBUG [RS:1;jenkins-hbase4:46759] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/oldWALs 2023-02-15 23:01:32,409 INFO [RS:1;jenkins-hbase4:46759] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46759%2C1676502088438:(num 1676502089747) 2023-02-15 23:01:32,409 DEBUG [RS:1;jenkins-hbase4:46759] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:32,409 INFO [RS:1;jenkins-hbase4:46759] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:32,410 INFO [RS:1;jenkins-hbase4:46759] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:32,410 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:32,410 INFO [RS:1;jenkins-hbase4:46759] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46759 2023-02-15 23:01:32,412 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:32,412 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:32,412 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:32,412 ERROR [Listener at localhost/39971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a42bb7b rejected from java.util.concurrent.ThreadPoolExecutor@e7d3eeb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:32,412 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46759,1676502088438 2023-02-15 23:01:32,412 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:32,412 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46759,1676502088438] 2023-02-15 23:01:32,412 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46759,1676502088438; numProcessing=1 2023-02-15 23:01:32,415 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46759,1676502088438 already deleted, retry=false 2023-02-15 23:01:32,415 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46759,1676502088438 expired; onlineServers=1 2023-02-15 23:01:32,505 DEBUG [RS:0;jenkins-hbase4:39295] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/oldWALs 2023-02-15 23:01:32,505 INFO [RS:0;jenkins-hbase4:39295] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39295%2C1676502088408:(num 1676502089382) 2023-02-15 23:01:32,505 DEBUG [RS:0;jenkins-hbase4:39295] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:32,505 INFO [RS:0;jenkins-hbase4:39295] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:32,506 INFO [RS:0;jenkins-hbase4:39295] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:32,506 INFO [RS:0;jenkins-hbase4:39295] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:32,506 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:32,506 INFO [RS:0;jenkins-hbase4:39295] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:32,506 INFO [RS:0;jenkins-hbase4:39295] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:32,507 INFO [RS:0;jenkins-hbase4:39295] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39295 2023-02-15 23:01:32,512 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:32,512 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39295,1676502088408 2023-02-15 23:01:32,513 ERROR [Listener at localhost/39971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@779d12c0 rejected from java.util.concurrent.ThreadPoolExecutor@73a298eb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:32,513 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39295,1676502088408] 2023-02-15 23:01:32,513 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39295,1676502088408; numProcessing=2 2023-02-15 23:01:32,515 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39295,1676502088408 already deleted, retry=false 2023-02-15 23:01:32,515 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39295,1676502088408 expired; onlineServers=0 2023-02-15 23:01:32,515 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,32933,1676502088351' ***** 2023-02-15 23:01:32,515 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 23:01:32,515 DEBUG [M:0;jenkins-hbase4:32933] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b4674fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:32,515 INFO [M:0;jenkins-hbase4:32933] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,32933,1676502088351 2023-02-15 23:01:32,515 INFO [M:0;jenkins-hbase4:32933] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,32933,1676502088351; all regions closed. 2023-02-15 23:01:32,516 DEBUG [M:0;jenkins-hbase4:32933] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:32,516 DEBUG [M:0;jenkins-hbase4:32933] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 23:01:32,516 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 23:01:32,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502088607] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502088607,5,FailOnTimeoutGroup] 2023-02-15 23:01:32,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502088607] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502088607,5,FailOnTimeoutGroup] 2023-02-15 23:01:32,516 DEBUG [M:0;jenkins-hbase4:32933] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 23:01:32,517 INFO [M:0;jenkins-hbase4:32933] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 23:01:32,517 INFO [M:0;jenkins-hbase4:32933] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 23:01:32,517 INFO [M:0;jenkins-hbase4:32933] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 23:01:32,517 DEBUG [M:0;jenkins-hbase4:32933] master.HMaster(1512): Stopping service threads 2023-02-15 23:01:32,517 INFO [M:0;jenkins-hbase4:32933] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 23:01:32,518 ERROR [M:0;jenkins-hbase4:32933] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 23:01:32,518 INFO [M:0;jenkins-hbase4:32933] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 23:01:32,518 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:32,518 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 23:01:32,518 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:32,518 DEBUG [M:0;jenkins-hbase4:32933] zookeeper.ZKUtil(398): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 23:01:32,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:32,519 WARN [M:0;jenkins-hbase4:32933] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 23:01:32,519 INFO [M:0;jenkins-hbase4:32933] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 23:01:32,519 INFO [M:0;jenkins-hbase4:32933] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 23:01:32,520 DEBUG [M:0;jenkins-hbase4:32933] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:32,520 INFO [M:0;jenkins-hbase4:32933] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:32,520 DEBUG [M:0;jenkins-hbase4:32933] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:32,520 DEBUG [M:0;jenkins-hbase4:32933] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:32,520 DEBUG [M:0;jenkins-hbase4:32933] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:32,520 INFO [M:0;jenkins-hbase4:32933] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.91 KB heapSize=66.85 KB 2023-02-15 23:01:32,528 INFO [M:0;jenkins-hbase4:32933] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.91 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1d33d2af75484cd8bc465baeffc59838 2023-02-15 23:01:32,532 DEBUG [M:0;jenkins-hbase4:32933] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1d33d2af75484cd8bc465baeffc59838 as hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1d33d2af75484cd8bc465baeffc59838 2023-02-15 23:01:32,536 INFO [M:0;jenkins-hbase4:32933] regionserver.HStore(1080): Added hdfs://localhost:32913/user/jenkins/test-data/bdeef801-f856-0662-f61a-627c95842eed/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1d33d2af75484cd8bc465baeffc59838, entries=17, sequenceid=132, filesize=8.7 K 2023-02-15 23:01:32,537 INFO [M:0;jenkins-hbase4:32933] regionserver.HRegion(2947): Finished flush of dataSize ~55.91 KB/57248, heapSize ~66.84 KB/68440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-15 23:01:32,537 INFO [M:0;jenkins-hbase4:32933] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:32,537 DEBUG [M:0;jenkins-hbase4:32933] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:32,540 INFO [M:0;jenkins-hbase4:32933] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 23:01:32,540 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:32,541 INFO [M:0;jenkins-hbase4:32933] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32933 2023-02-15 23:01:32,543 DEBUG [M:0;jenkins-hbase4:32933] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,32933,1676502088351 already deleted, retry=false 2023-02-15 23:01:32,696 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:32,696 INFO [M:0;jenkins-hbase4:32933] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,32933,1676502088351; zookeeper connection closed. 2023-02-15 23:01:32,696 ERROR [Listener at localhost/39971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4840301b rejected from java.util.concurrent.ThreadPoolExecutor@4c7fadcb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:32,698 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): master:32933-0x1005a37a4500000, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:32,698 ERROR [Listener at localhost/39971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71b787aa rejected from java.util.concurrent.ThreadPoolExecutor@4c7fadcb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:32,796 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:32,796 INFO [RS:0;jenkins-hbase4:39295] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39295,1676502088408; zookeeper connection closed. 2023-02-15 23:01:32,796 ERROR [Listener at localhost/39971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1848f39f rejected from java.util.concurrent.ThreadPoolExecutor@73a298eb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:32,797 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1e78d00f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1e78d00f 2023-02-15 23:01:32,797 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:39295-0x1005a37a4500001, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:32,797 ERROR [Listener at localhost/39971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60de5c94 rejected from java.util.concurrent.ThreadPoolExecutor@73a298eb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:32,897 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:32,897 INFO [RS:1;jenkins-hbase4:46759] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46759,1676502088438; zookeeper connection closed. 2023-02-15 23:01:32,897 ERROR [Listener at localhost/39971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@65f81c39 rejected from java.util.concurrent.ThreadPoolExecutor@e7d3eeb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:32,897 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@430f6886] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@430f6886 2023-02-15 23:01:32,897 DEBUG [Listener at localhost/39971-EventThread] zookeeper.ZKWatcher(600): regionserver:46759-0x1005a37a4500002, quorum=127.0.0.1:57163, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:32,897 ERROR [Listener at localhost/39971-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d13095c rejected from java.util.concurrent.ThreadPoolExecutor@e7d3eeb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:32,897 INFO [Listener at localhost/39971] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 23:01:32,897 WARN [Listener at localhost/39971] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:32,901 INFO [Listener at localhost/39971] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:33,006 WARN [BP-340639669-172.31.14.131-1676502087773 heartbeating to localhost/127.0.0.1:32913] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 23:01:33,007 WARN [BP-340639669-172.31.14.131-1676502087773 heartbeating to localhost/127.0.0.1:32913] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-340639669-172.31.14.131-1676502087773 (Datanode Uuid d8d50a16-e04e-4401-a4ce-254404fbf5d5) service to localhost/127.0.0.1:32913 2023-02-15 23:01:33,007 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/cluster_37bd62d9-b09a-2614-f40b-d447d92e1626/dfs/data/data3/current/BP-340639669-172.31.14.131-1676502087773] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:33,008 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/cluster_37bd62d9-b09a-2614-f40b-d447d92e1626/dfs/data/data4/current/BP-340639669-172.31.14.131-1676502087773] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:33,009 WARN [Listener at localhost/39971] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:33,012 INFO [Listener at localhost/39971] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:33,117 WARN [BP-340639669-172.31.14.131-1676502087773 heartbeating to localhost/127.0.0.1:32913] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 23:01:33,117 WARN [BP-340639669-172.31.14.131-1676502087773 heartbeating to localhost/127.0.0.1:32913] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-340639669-172.31.14.131-1676502087773 (Datanode Uuid 8256cabd-406e-4964-aae7-088ad69129fb) service to localhost/127.0.0.1:32913 2023-02-15 23:01:33,117 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/cluster_37bd62d9-b09a-2614-f40b-d447d92e1626/dfs/data/data1/current/BP-340639669-172.31.14.131-1676502087773] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:33,118 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/cluster_37bd62d9-b09a-2614-f40b-d447d92e1626/dfs/data/data2/current/BP-340639669-172.31.14.131-1676502087773] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:33,128 INFO [Listener at localhost/39971] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:33,242 INFO [Listener at localhost/39971] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 23:01:33,263 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 23:01:33,275 INFO [Listener at localhost/39971] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=178 (was 157) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:32913 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,32933,1676502088351)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:32913 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39971 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:32913 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:32913 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:32913 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:32913 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:32913 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=569 (was 540) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=342 (was 363), ProcessCount=166 (was 166), AvailableMemoryMB=2606 (was 2645) 2023-02-15 23:01:33,284 INFO [Listener at localhost/39971] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=178, OpenFileDescriptor=569, MaxFileDescriptor=60000, SystemLoadAverage=342, ProcessCount=166, AvailableMemoryMB=2606 2023-02-15 23:01:33,294 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/hadoop.log.dir so I do NOT create it in target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac 2023-02-15 23:01:33,294 WARN [Listener at localhost/39971] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 23:01:33,294 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/hadoop.tmp.dir so I do NOT create it in target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac 2023-02-15 23:01:33,294 WARN [Listener at localhost/39971] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b9a7ad0b-4cd1-e245-3099-612f379e1a12/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 23:01:33,294 DEBUG [Listener at localhost/39971] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac 2023-02-15 23:01:33,294 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 23:01:33,294 INFO [Listener at localhost/39971] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/cluster_2c2b593f-828c-b9dd-db65-87ecd2e8d178, deleteOnExit=true 2023-02-15 23:01:33,294 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 23:01:33,295 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/test.cache.data in system properties and HBase conf 2023-02-15 23:01:33,295 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 23:01:33,295 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/hadoop.log.dir in system properties and HBase conf 2023-02-15 23:01:33,295 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 23:01:33,295 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 23:01:33,295 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 23:01:33,295 DEBUG [Listener at localhost/39971] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 23:01:33,295 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:01:33,295 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:01:33,295 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 23:01:33,296 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:01:33,296 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 23:01:33,296 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 23:01:33,296 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:01:33,296 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:01:33,296 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 23:01:33,296 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/nfs.dump.dir in system properties and HBase conf 2023-02-15 23:01:33,296 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/java.io.tmpdir in system properties and HBase conf 2023-02-15 23:01:33,296 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:01:33,296 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 23:01:33,296 INFO [Listener at localhost/39971] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 23:01:33,300 WARN [Listener at localhost/39971] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:01:33,301 WARN [Listener at localhost/39971] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:01:33,336 WARN [Listener at localhost/39971] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:33,338 INFO [Listener at localhost/39971] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:33,342 INFO [Listener at localhost/39971] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/java.io.tmpdir/Jetty_localhost_35257_hdfs____.br938k/webapp 2023-02-15 23:01:33,434 INFO [Listener at localhost/39971] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35257 2023-02-15 23:01:33,438 WARN [Listener at localhost/39971] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:01:33,438 WARN [Listener at localhost/39971] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:01:33,485 WARN [Listener at localhost/33779] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:33,499 WARN [Listener at localhost/33779] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:01:33,503 WARN [Listener at localhost/33779] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:33,504 INFO [Listener at localhost/33779] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:33,508 INFO [Listener at localhost/33779] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/java.io.tmpdir/Jetty_localhost_44029_datanode____.9zumci/webapp 2023-02-15 23:01:33,600 INFO [Listener at localhost/33779] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44029 2023-02-15 23:01:33,607 WARN [Listener at localhost/33353] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:33,624 WARN [Listener at localhost/33353] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:01:33,626 WARN [Listener at localhost/33353] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:33,627 INFO [Listener at localhost/33353] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:33,630 INFO [Listener at localhost/33353] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/java.io.tmpdir/Jetty_localhost_40385_datanode____.37p2n9/webapp 2023-02-15 23:01:33,721 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1142e05d966b6978: Processing first storage report for DS-9fc892a1-83b4-4c52-89c1-449a68477bee from datanode edac5eee-1b14-42b7-9489-856ff1545d32 2023-02-15 23:01:33,721 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1142e05d966b6978: from storage DS-9fc892a1-83b4-4c52-89c1-449a68477bee node DatanodeRegistration(127.0.0.1:34913, datanodeUuid=edac5eee-1b14-42b7-9489-856ff1545d32, infoPort=36265, infoSecurePort=0, ipcPort=33353, storageInfo=lv=-57;cid=testClusterID;nsid=1033690419;c=1676502093303), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:33,721 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1142e05d966b6978: Processing first storage report for DS-1bdf657d-46e8-4643-a1dc-093f8e36318a from datanode edac5eee-1b14-42b7-9489-856ff1545d32 2023-02-15 23:01:33,721 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1142e05d966b6978: from storage DS-1bdf657d-46e8-4643-a1dc-093f8e36318a node DatanodeRegistration(127.0.0.1:34913, datanodeUuid=edac5eee-1b14-42b7-9489-856ff1545d32, infoPort=36265, infoSecurePort=0, ipcPort=33353, storageInfo=lv=-57;cid=testClusterID;nsid=1033690419;c=1676502093303), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:33,746 INFO [Listener at localhost/33353] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40385 2023-02-15 23:01:33,755 WARN [Listener at localhost/36203] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:33,850 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2938f94435832566: Processing first storage report for DS-0d7ea8b9-4922-426e-a051-253e97aa51de from datanode b7bc428b-e982-4c57-9a05-3ad92301ecc1 2023-02-15 23:01:33,850 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2938f94435832566: from storage DS-0d7ea8b9-4922-426e-a051-253e97aa51de node DatanodeRegistration(127.0.0.1:36503, datanodeUuid=b7bc428b-e982-4c57-9a05-3ad92301ecc1, infoPort=35489, infoSecurePort=0, ipcPort=36203, storageInfo=lv=-57;cid=testClusterID;nsid=1033690419;c=1676502093303), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:33,850 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2938f94435832566: Processing first storage report for DS-c490567e-5095-429a-bf5d-cff4821e0c0a from datanode b7bc428b-e982-4c57-9a05-3ad92301ecc1 2023-02-15 23:01:33,850 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2938f94435832566: from storage DS-c490567e-5095-429a-bf5d-cff4821e0c0a node DatanodeRegistration(127.0.0.1:36503, datanodeUuid=b7bc428b-e982-4c57-9a05-3ad92301ecc1, infoPort=35489, infoSecurePort=0, ipcPort=36203, storageInfo=lv=-57;cid=testClusterID;nsid=1033690419;c=1676502093303), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:33,867 DEBUG [Listener at localhost/36203] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac 2023-02-15 23:01:33,869 INFO [Listener at localhost/36203] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/cluster_2c2b593f-828c-b9dd-db65-87ecd2e8d178/zookeeper_0, clientPort=55667, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/cluster_2c2b593f-828c-b9dd-db65-87ecd2e8d178/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/cluster_2c2b593f-828c-b9dd-db65-87ecd2e8d178/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 23:01:33,870 INFO [Listener at localhost/36203] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55667 2023-02-15 23:01:33,870 INFO [Listener at localhost/36203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:33,871 INFO [Listener at localhost/36203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:33,888 INFO [Listener at localhost/36203] util.FSUtils(479): Created version file at hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd with version=8 2023-02-15 23:01:33,889 INFO [Listener at localhost/36203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:33,889 INFO [Listener at localhost/36203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:33,891 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/hbase-staging 2023-02-15 23:01:33,892 INFO [Listener at localhost/36203] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:33,892 INFO [Listener at localhost/36203] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:33,892 INFO [Listener at localhost/36203] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:33,893 INFO [Listener at localhost/36203] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:33,893 INFO [Listener at localhost/36203] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:33,893 INFO [Listener at localhost/36203] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:33,893 INFO [Listener at localhost/36203] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:33,894 INFO [Listener at localhost/36203] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38835 2023-02-15 23:01:33,894 INFO [Listener at localhost/36203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:33,895 INFO [Listener at localhost/36203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:33,896 INFO [Listener at localhost/36203] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38835 connecting to ZooKeeper ensemble=127.0.0.1:55667 2023-02-15 23:01:33,907 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:388350x0, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:33,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38835-0x1005a37b9f10000 connected 2023-02-15 23:01:33,922 DEBUG [Listener at localhost/36203] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:33,923 DEBUG [Listener at localhost/36203] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:33,923 DEBUG [Listener at localhost/36203] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:33,924 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38835 2023-02-15 23:01:33,924 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38835 2023-02-15 23:01:33,924 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38835 2023-02-15 23:01:33,925 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38835 2023-02-15 23:01:33,928 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38835 2023-02-15 23:01:33,928 INFO [Listener at localhost/36203] master.HMaster(444): hbase.rootdir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd, hbase.cluster.distributed=false 2023-02-15 23:01:33,940 INFO [Listener at localhost/36203] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:33,940 INFO [Listener at localhost/36203] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:33,940 INFO [Listener at localhost/36203] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:33,940 INFO [Listener at localhost/36203] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:33,940 INFO [Listener at localhost/36203] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:33,940 INFO [Listener at localhost/36203] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:33,941 INFO [Listener at localhost/36203] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:33,941 INFO [Listener at localhost/36203] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37799 2023-02-15 23:01:33,942 INFO [Listener at localhost/36203] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:33,943 DEBUG [Listener at localhost/36203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:33,943 INFO [Listener at localhost/36203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:33,944 INFO [Listener at localhost/36203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:33,945 INFO [Listener at localhost/36203] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37799 connecting to ZooKeeper ensemble=127.0.0.1:55667 2023-02-15 23:01:33,950 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:377990x0, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:33,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37799-0x1005a37b9f10001 connected 2023-02-15 23:01:33,951 DEBUG [Listener at localhost/36203] zookeeper.ZKUtil(164): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:33,952 DEBUG [Listener at localhost/36203] zookeeper.ZKUtil(164): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:33,952 DEBUG [Listener at localhost/36203] zookeeper.ZKUtil(164): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:33,954 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37799 2023-02-15 23:01:33,954 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37799 2023-02-15 23:01:33,954 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37799 2023-02-15 23:01:33,956 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37799 2023-02-15 23:01:33,956 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37799 2023-02-15 23:01:33,966 INFO [Listener at localhost/36203] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:33,966 INFO [Listener at localhost/36203] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:33,967 INFO [Listener at localhost/36203] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:33,967 INFO [Listener at localhost/36203] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:33,967 INFO [Listener at localhost/36203] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:33,967 INFO [Listener at localhost/36203] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:33,967 INFO [Listener at localhost/36203] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:33,968 INFO [Listener at localhost/36203] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37411 2023-02-15 23:01:33,968 INFO [Listener at localhost/36203] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:33,971 DEBUG [Listener at localhost/36203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:33,972 INFO [Listener at localhost/36203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:33,973 INFO [Listener at localhost/36203] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:33,974 INFO [Listener at localhost/36203] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37411 connecting to ZooKeeper ensemble=127.0.0.1:55667 2023-02-15 23:01:33,977 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:374110x0, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:33,978 DEBUG [Listener at localhost/36203] zookeeper.ZKUtil(164): regionserver:374110x0, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:33,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37411-0x1005a37b9f10002 connected 2023-02-15 23:01:33,979 DEBUG [Listener at localhost/36203] zookeeper.ZKUtil(164): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:33,979 DEBUG [Listener at localhost/36203] zookeeper.ZKUtil(164): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:33,979 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37411 2023-02-15 23:01:33,980 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37411 2023-02-15 23:01:33,981 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37411 2023-02-15 23:01:33,981 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37411 2023-02-15 23:01:33,984 DEBUG [Listener at localhost/36203] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37411 2023-02-15 23:01:33,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38835,1676502093892 2023-02-15 23:01:33,987 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:33,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38835,1676502093892 2023-02-15 23:01:33,989 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:33,989 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:33,989 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:33,989 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:33,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:33,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38835,1676502093892 from backup master directory 2023-02-15 23:01:33,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:33,991 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38835,1676502093892 2023-02-15 23:01:33,991 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:33,991 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:33,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38835,1676502093892 2023-02-15 23:01:34,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/hbase.id with ID: 04679ede-c83c-4a93-9f60-a7c0dcf7cce4 2023-02-15 23:01:34,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:34,018 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:34,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x51ba3076 to 127.0.0.1:55667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:34,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@481ee488, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:34,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:34,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 23:01:34,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:34,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/MasterData/data/master/store-tmp 2023-02-15 23:01:34,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:34,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:34,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:34,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:34,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:34,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:34,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:34,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:34,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/MasterData/WALs/jenkins-hbase4.apache.org,38835,1676502093892 2023-02-15 23:01:34,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38835%2C1676502093892, suffix=, logDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/MasterData/WALs/jenkins-hbase4.apache.org,38835,1676502093892, archiveDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/MasterData/oldWALs, maxLogs=10 2023-02-15 23:01:34,062 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36503,DS-0d7ea8b9-4922-426e-a051-253e97aa51de,DISK] 2023-02-15 23:01:34,063 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34913,DS-9fc892a1-83b4-4c52-89c1-449a68477bee,DISK] 2023-02-15 23:01:34,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/MasterData/WALs/jenkins-hbase4.apache.org,38835,1676502093892/jenkins-hbase4.apache.org%2C38835%2C1676502093892.1676502094049 2023-02-15 23:01:34,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36503,DS-0d7ea8b9-4922-426e-a051-253e97aa51de,DISK], DatanodeInfoWithStorage[127.0.0.1:34913,DS-9fc892a1-83b4-4c52-89c1-449a68477bee,DISK]] 2023-02-15 23:01:34,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:34,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:34,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:34,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:34,066 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:34,068 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 23:01:34,068 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 23:01:34,068 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:34,069 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:34,069 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:34,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:34,073 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:34,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72019980, jitterRate=0.07318133115768433}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:34,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:34,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 23:01:34,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 23:01:34,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 23:01:34,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 23:01:34,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 23:01:34,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 23:01:34,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 23:01:34,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 23:01:34,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 23:01:34,095 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 23:01:34,095 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 23:01:34,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 23:01:34,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 23:01:34,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 23:01:34,098 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:34,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 23:01:34,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 23:01:34,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 23:01:34,101 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:34,101 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:34,101 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:34,101 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:34,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38835,1676502093892, sessionid=0x1005a37b9f10000, setting cluster-up flag (Was=false) 2023-02-15 23:01:34,107 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:34,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 23:01:34,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38835,1676502093892 2023-02-15 23:01:34,115 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:34,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 23:01:34,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38835,1676502093892 2023-02-15 23:01:34,122 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.hbase-snapshot/.tmp 2023-02-15 23:01:34,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:34,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:34,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:34,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:34,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:34,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 23:01:34,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:34,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676502124134 2023-02-15 23:01:34,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 23:01:34,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 23:01:34,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 23:01:34,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 23:01:34,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 23:01:34,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 23:01:34,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,135 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:34,136 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 23:01:34,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 23:01:34,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 23:01:34,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 23:01:34,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 23:01:34,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 23:01:34,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502094136,5,FailOnTimeoutGroup] 2023-02-15 23:01:34,137 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:34,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502094136,5,FailOnTimeoutGroup] 2023-02-15 23:01:34,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 23:01:34,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,148 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:34,149 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:34,149 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd 2023-02-15 23:01:34,156 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:34,157 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:34,158 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/info 2023-02-15 23:01:34,158 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:34,159 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:34,159 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:34,160 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:34,160 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:34,160 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:34,160 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:34,161 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/table 2023-02-15 23:01:34,162 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:34,162 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:34,163 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740 2023-02-15 23:01:34,163 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740 2023-02-15 23:01:34,164 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:34,165 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:34,167 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:34,167 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74508763, jitterRate=0.11026708781719208}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:34,167 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:34,168 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:34,168 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:34,168 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:34,168 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:34,168 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:34,168 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:34,168 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:34,169 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:34,169 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 23:01:34,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 23:01:34,171 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 23:01:34,172 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 23:01:34,185 INFO [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(952): ClusterId : 04679ede-c83c-4a93-9f60-a7c0dcf7cce4 2023-02-15 23:01:34,186 INFO [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(952): ClusterId : 04679ede-c83c-4a93-9f60-a7c0dcf7cce4 2023-02-15 23:01:34,186 DEBUG [RS:0;jenkins-hbase4:37799] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:34,186 DEBUG [RS:1;jenkins-hbase4:37411] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:34,188 DEBUG [RS:0;jenkins-hbase4:37799] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:34,188 DEBUG [RS:1;jenkins-hbase4:37411] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:34,188 DEBUG [RS:0;jenkins-hbase4:37799] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:34,188 DEBUG [RS:1;jenkins-hbase4:37411] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:34,190 DEBUG [RS:0;jenkins-hbase4:37799] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:34,192 DEBUG [RS:0;jenkins-hbase4:37799] zookeeper.ReadOnlyZKClient(139): Connect 0x73df3157 to 127.0.0.1:55667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:34,192 DEBUG [RS:1;jenkins-hbase4:37411] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:34,193 DEBUG [RS:1;jenkins-hbase4:37411] zookeeper.ReadOnlyZKClient(139): Connect 0x360a9ea6 to 127.0.0.1:55667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:34,199 DEBUG [RS:0;jenkins-hbase4:37799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d18d15c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:34,199 DEBUG [RS:1;jenkins-hbase4:37411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38cd7617, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:34,200 DEBUG [RS:0;jenkins-hbase4:37799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79275a27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:34,200 DEBUG [RS:1;jenkins-hbase4:37411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cf2f5d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:34,208 DEBUG [RS:1;jenkins-hbase4:37411] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37411 2023-02-15 23:01:34,208 INFO [RS:1;jenkins-hbase4:37411] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:34,208 INFO [RS:1;jenkins-hbase4:37411] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:34,208 DEBUG [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:34,208 INFO [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38835,1676502093892 with isa=jenkins-hbase4.apache.org/172.31.14.131:37411, startcode=1676502093966 2023-02-15 23:01:34,209 DEBUG [RS:1;jenkins-hbase4:37411] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:34,210 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60891, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:34,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:34,212 DEBUG [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd 2023-02-15 23:01:34,212 DEBUG [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33779 2023-02-15 23:01:34,212 DEBUG [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:34,212 DEBUG [RS:0;jenkins-hbase4:37799] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37799 2023-02-15 23:01:34,212 INFO [RS:0;jenkins-hbase4:37799] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:34,212 INFO [RS:0;jenkins-hbase4:37799] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:34,212 DEBUG [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:34,213 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:34,213 INFO [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38835,1676502093892 with isa=jenkins-hbase4.apache.org/172.31.14.131:37799, startcode=1676502093940 2023-02-15 23:01:34,214 DEBUG [RS:1;jenkins-hbase4:37411] zookeeper.ZKUtil(162): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:34,214 DEBUG [RS:0;jenkins-hbase4:37799] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:34,214 WARN [RS:1;jenkins-hbase4:37411] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:34,214 INFO [RS:1;jenkins-hbase4:37411] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:34,214 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37411,1676502093966] 2023-02-15 23:01:34,215 DEBUG [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/WALs/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:34,217 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55997, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:34,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:34,218 DEBUG [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd 2023-02-15 23:01:34,218 DEBUG [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33779 2023-02-15 23:01:34,218 DEBUG [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:34,228 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:34,228 DEBUG [RS:1;jenkins-hbase4:37411] zookeeper.ZKUtil(162): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:34,228 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:34,228 DEBUG [RS:0;jenkins-hbase4:37799] zookeeper.ZKUtil(162): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:34,228 WARN [RS:0;jenkins-hbase4:37799] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:34,228 INFO [RS:0;jenkins-hbase4:37799] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:34,228 DEBUG [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/WALs/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:34,228 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37799,1676502093940] 2023-02-15 23:01:34,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:34,229 DEBUG [RS:1;jenkins-hbase4:37411] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:34,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:34,229 INFO [RS:1;jenkins-hbase4:37411] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:34,232 INFO [RS:1;jenkins-hbase4:37411] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:34,232 INFO [RS:1;jenkins-hbase4:37411] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:34,232 INFO [RS:1;jenkins-hbase4:37411] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,232 DEBUG [RS:0;jenkins-hbase4:37799] zookeeper.ZKUtil(162): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:34,232 INFO [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:34,233 DEBUG [RS:0;jenkins-hbase4:37799] zookeeper.ZKUtil(162): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:34,233 INFO [RS:1;jenkins-hbase4:37411] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,234 DEBUG [RS:1;jenkins-hbase4:37411] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,234 DEBUG [RS:1;jenkins-hbase4:37411] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,234 DEBUG [RS:0;jenkins-hbase4:37799] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:34,234 DEBUG [RS:1;jenkins-hbase4:37411] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,234 DEBUG [RS:1;jenkins-hbase4:37411] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,234 INFO [RS:0;jenkins-hbase4:37799] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:34,234 DEBUG [RS:1;jenkins-hbase4:37411] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,234 DEBUG [RS:1;jenkins-hbase4:37411] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:34,234 DEBUG [RS:1;jenkins-hbase4:37411] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,234 DEBUG [RS:1;jenkins-hbase4:37411] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,234 DEBUG [RS:1;jenkins-hbase4:37411] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,234 DEBUG [RS:1;jenkins-hbase4:37411] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,240 INFO [RS:0;jenkins-hbase4:37799] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:34,240 INFO [RS:1;jenkins-hbase4:37411] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,241 INFO [RS:1;jenkins-hbase4:37411] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,241 INFO [RS:0;jenkins-hbase4:37799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:34,241 INFO [RS:1;jenkins-hbase4:37411] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,241 INFO [RS:0;jenkins-hbase4:37799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,241 INFO [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:34,242 INFO [RS:0;jenkins-hbase4:37799] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,243 DEBUG [RS:0;jenkins-hbase4:37799] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,243 DEBUG [RS:0;jenkins-hbase4:37799] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,243 DEBUG [RS:0;jenkins-hbase4:37799] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,243 DEBUG [RS:0;jenkins-hbase4:37799] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,243 DEBUG [RS:0;jenkins-hbase4:37799] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,243 DEBUG [RS:0;jenkins-hbase4:37799] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:34,243 DEBUG [RS:0;jenkins-hbase4:37799] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,243 DEBUG [RS:0;jenkins-hbase4:37799] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,243 DEBUG [RS:0;jenkins-hbase4:37799] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,243 DEBUG [RS:0;jenkins-hbase4:37799] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:34,244 INFO [RS:0;jenkins-hbase4:37799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,245 INFO [RS:0;jenkins-hbase4:37799] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,245 INFO [RS:0;jenkins-hbase4:37799] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,253 INFO [RS:1;jenkins-hbase4:37411] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:34,253 INFO [RS:1;jenkins-hbase4:37411] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37411,1676502093966-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,257 INFO [RS:0;jenkins-hbase4:37799] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:34,257 INFO [RS:0;jenkins-hbase4:37799] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37799,1676502093940-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,263 INFO [RS:1;jenkins-hbase4:37411] regionserver.Replication(203): jenkins-hbase4.apache.org,37411,1676502093966 started 2023-02-15 23:01:34,263 INFO [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37411,1676502093966, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37411, sessionid=0x1005a37b9f10002 2023-02-15 23:01:34,263 DEBUG [RS:1;jenkins-hbase4:37411] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:34,263 DEBUG [RS:1;jenkins-hbase4:37411] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:34,263 DEBUG [RS:1;jenkins-hbase4:37411] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37411,1676502093966' 2023-02-15 23:01:34,263 DEBUG [RS:1;jenkins-hbase4:37411] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:34,263 DEBUG [RS:1;jenkins-hbase4:37411] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:34,264 DEBUG [RS:1;jenkins-hbase4:37411] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:34,264 DEBUG [RS:1;jenkins-hbase4:37411] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:34,264 DEBUG [RS:1;jenkins-hbase4:37411] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:34,264 DEBUG [RS:1;jenkins-hbase4:37411] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37411,1676502093966' 2023-02-15 23:01:34,264 DEBUG [RS:1;jenkins-hbase4:37411] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:34,264 DEBUG [RS:1;jenkins-hbase4:37411] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:34,264 DEBUG [RS:1;jenkins-hbase4:37411] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:34,264 INFO [RS:1;jenkins-hbase4:37411] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:34,264 INFO [RS:1;jenkins-hbase4:37411] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:34,267 INFO [RS:0;jenkins-hbase4:37799] regionserver.Replication(203): jenkins-hbase4.apache.org,37799,1676502093940 started 2023-02-15 23:01:34,267 INFO [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37799,1676502093940, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37799, sessionid=0x1005a37b9f10001 2023-02-15 23:01:34,267 DEBUG [RS:0;jenkins-hbase4:37799] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:34,267 DEBUG [RS:0;jenkins-hbase4:37799] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:34,267 DEBUG [RS:0;jenkins-hbase4:37799] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37799,1676502093940' 2023-02-15 23:01:34,267 DEBUG [RS:0;jenkins-hbase4:37799] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:34,268 DEBUG [RS:0;jenkins-hbase4:37799] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:34,268 DEBUG [RS:0;jenkins-hbase4:37799] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:34,268 DEBUG [RS:0;jenkins-hbase4:37799] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:34,268 DEBUG [RS:0;jenkins-hbase4:37799] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:34,268 DEBUG [RS:0;jenkins-hbase4:37799] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37799,1676502093940' 2023-02-15 23:01:34,268 DEBUG [RS:0;jenkins-hbase4:37799] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:34,268 DEBUG [RS:0;jenkins-hbase4:37799] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:34,268 DEBUG [RS:0;jenkins-hbase4:37799] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:34,268 INFO [RS:0;jenkins-hbase4:37799] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:34,268 INFO [RS:0;jenkins-hbase4:37799] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:34,322 DEBUG [jenkins-hbase4:38835] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 23:01:34,322 DEBUG [jenkins-hbase4:38835] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:34,324 DEBUG [jenkins-hbase4:38835] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:34,324 DEBUG [jenkins-hbase4:38835] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:34,324 DEBUG [jenkins-hbase4:38835] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:34,325 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37411,1676502093966, state=OPENING 2023-02-15 23:01:34,326 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 23:01:34,328 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:34,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37411,1676502093966}] 2023-02-15 23:01:34,328 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:34,482 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:34,483 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:34,484 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41012, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:34,488 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 23:01:34,488 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:34,489 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 23:01:34,489 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37411%2C1676502093966.meta, suffix=.meta, logDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/WALs/jenkins-hbase4.apache.org,37411,1676502093966, archiveDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/oldWALs, maxLogs=32 2023-02-15 23:01:34,510 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36503,DS-0d7ea8b9-4922-426e-a051-253e97aa51de,DISK] 2023-02-15 23:01:34,510 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34913,DS-9fc892a1-83b4-4c52-89c1-449a68477bee,DISK] 2023-02-15 23:01:34,516 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/WALs/jenkins-hbase4.apache.org,37411,1676502093966/jenkins-hbase4.apache.org%2C37411%2C1676502093966.meta.1676502094490.meta 2023-02-15 23:01:34,517 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34913,DS-9fc892a1-83b4-4c52-89c1-449a68477bee,DISK], DatanodeInfoWithStorage[127.0.0.1:36503,DS-0d7ea8b9-4922-426e-a051-253e97aa51de,DISK]] 2023-02-15 23:01:34,517 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:34,517 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 23:01:34,517 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 23:01:34,517 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 23:01:34,518 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 23:01:34,518 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:34,518 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 23:01:34,518 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 23:01:34,519 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:34,520 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/info 2023-02-15 23:01:34,520 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/info 2023-02-15 23:01:34,520 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:34,521 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:34,521 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:34,522 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:34,522 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:34,522 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:34,523 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:34,523 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:34,523 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/table 2023-02-15 23:01:34,523 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/table 2023-02-15 23:01:34,524 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:34,524 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:34,525 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740 2023-02-15 23:01:34,526 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740 2023-02-15 23:01:34,528 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:34,529 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:34,530 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71857904, jitterRate=0.07076621055603027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:34,530 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:34,530 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676502094482 2023-02-15 23:01:34,535 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 23:01:34,537 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 23:01:34,538 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37411,1676502093966, state=OPEN 2023-02-15 23:01:34,540 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 23:01:34,540 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:34,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 23:01:34,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37411,1676502093966 in 212 msec 2023-02-15 23:01:34,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 23:01:34,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 373 msec 2023-02-15 23:01:34,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 421 msec 2023-02-15 23:01:34,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676502094545, completionTime=-1 2023-02-15 23:01:34,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 23:01:34,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 23:01:34,548 DEBUG [hconnection-0x338e7536-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:34,549 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41022, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:34,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 23:01:34,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676502154550 2023-02-15 23:01:34,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676502214550 2023-02-15 23:01:34,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-15 23:01:34,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38835,1676502093892-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38835,1676502093892-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38835,1676502093892-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38835, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:34,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 23:01:34,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:34,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 23:01:34,560 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 23:01:34,561 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:34,561 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:34,563 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/hbase/namespace/27d53ea1cf641baff3aed42d8892f4aa 2023-02-15 23:01:34,563 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/hbase/namespace/27d53ea1cf641baff3aed42d8892f4aa empty. 2023-02-15 23:01:34,564 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/hbase/namespace/27d53ea1cf641baff3aed42d8892f4aa 2023-02-15 23:01:34,564 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 23:01:34,573 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:34,574 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 27d53ea1cf641baff3aed42d8892f4aa, NAME => 'hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp 2023-02-15 23:01:34,586 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:34,586 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 27d53ea1cf641baff3aed42d8892f4aa, disabling compactions & flushes 2023-02-15 23:01:34,586 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. 2023-02-15 23:01:34,586 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. 2023-02-15 23:01:34,586 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. after waiting 0 ms 2023-02-15 23:01:34,587 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. 2023-02-15 23:01:34,587 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. 2023-02-15 23:01:34,587 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 27d53ea1cf641baff3aed42d8892f4aa: 2023-02-15 23:01:34,589 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:34,590 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502094590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502094590"}]},"ts":"1676502094590"} 2023-02-15 23:01:34,595 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 23:01:34,595 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:34,596 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502094596"}]},"ts":"1676502094596"} 2023-02-15 23:01:34,597 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 23:01:34,601 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:34,602 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:34,602 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:34,602 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:34,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=27d53ea1cf641baff3aed42d8892f4aa, ASSIGN}] 2023-02-15 23:01:34,607 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=27d53ea1cf641baff3aed42d8892f4aa, ASSIGN 2023-02-15 23:01:34,609 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=27d53ea1cf641baff3aed42d8892f4aa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37799,1676502093940; forceNewPlan=false, retain=false 2023-02-15 23:01:34,759 INFO [jenkins-hbase4:38835] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 23:01:34,760 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=27d53ea1cf641baff3aed42d8892f4aa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:34,760 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502094760"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502094760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502094760"}]},"ts":"1676502094760"} 2023-02-15 23:01:34,762 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 27d53ea1cf641baff3aed42d8892f4aa, server=jenkins-hbase4.apache.org,37799,1676502093940}] 2023-02-15 23:01:34,915 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:34,915 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:34,917 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60556, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:34,920 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. 2023-02-15 23:01:34,921 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37799%2C1676502093940, suffix=, logDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/WALs/jenkins-hbase4.apache.org,37799,1676502093940, archiveDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/oldWALs, maxLogs=32 2023-02-15 23:01:34,943 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34913,DS-9fc892a1-83b4-4c52-89c1-449a68477bee,DISK] 2023-02-15 23:01:34,946 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36503,DS-0d7ea8b9-4922-426e-a051-253e97aa51de,DISK] 2023-02-15 23:01:34,948 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/WALs/jenkins-hbase4.apache.org,37799,1676502093940/jenkins-hbase4.apache.org%2C37799%2C1676502093940.1676502094922 2023-02-15 23:01:34,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34913,DS-9fc892a1-83b4-4c52-89c1-449a68477bee,DISK], DatanodeInfoWithStorage[127.0.0.1:36503,DS-0d7ea8b9-4922-426e-a051-253e97aa51de,DISK]] 2023-02-15 23:01:34,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 27d53ea1cf641baff3aed42d8892f4aa, NAME => 'hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:34,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 27d53ea1cf641baff3aed42d8892f4aa 2023-02-15 23:01:34,949 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:34,949 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 27d53ea1cf641baff3aed42d8892f4aa 2023-02-15 23:01:34,949 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 27d53ea1cf641baff3aed42d8892f4aa 2023-02-15 23:01:34,952 INFO [StoreOpener-27d53ea1cf641baff3aed42d8892f4aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 27d53ea1cf641baff3aed42d8892f4aa 2023-02-15 23:01:34,953 DEBUG [StoreOpener-27d53ea1cf641baff3aed42d8892f4aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/namespace/27d53ea1cf641baff3aed42d8892f4aa/info 2023-02-15 23:01:34,953 DEBUG [StoreOpener-27d53ea1cf641baff3aed42d8892f4aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/namespace/27d53ea1cf641baff3aed42d8892f4aa/info 2023-02-15 23:01:34,954 INFO [StoreOpener-27d53ea1cf641baff3aed42d8892f4aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27d53ea1cf641baff3aed42d8892f4aa columnFamilyName info 2023-02-15 23:01:34,954 INFO [StoreOpener-27d53ea1cf641baff3aed42d8892f4aa-1] regionserver.HStore(310): Store=27d53ea1cf641baff3aed42d8892f4aa/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:34,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/namespace/27d53ea1cf641baff3aed42d8892f4aa 2023-02-15 23:01:34,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/namespace/27d53ea1cf641baff3aed42d8892f4aa 2023-02-15 23:01:34,958 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 27d53ea1cf641baff3aed42d8892f4aa 2023-02-15 23:01:34,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/namespace/27d53ea1cf641baff3aed42d8892f4aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:34,960 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 27d53ea1cf641baff3aed42d8892f4aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74236427, jitterRate=0.10620896518230438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:34,960 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 27d53ea1cf641baff3aed42d8892f4aa: 2023-02-15 23:01:34,960 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa., pid=6, masterSystemTime=1676502094915 2023-02-15 23:01:34,965 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=27d53ea1cf641baff3aed42d8892f4aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:34,965 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502094965"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502094965"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502094965"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502094965"}]},"ts":"1676502094965"} 2023-02-15 23:01:34,967 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. 2023-02-15 23:01:34,967 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. 2023-02-15 23:01:34,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 23:01:34,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 27d53ea1cf641baff3aed42d8892f4aa, server=jenkins-hbase4.apache.org,37799,1676502093940 in 205 msec 2023-02-15 23:01:34,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 23:01:34,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=27d53ea1cf641baff3aed42d8892f4aa, ASSIGN in 367 msec 2023-02-15 23:01:34,971 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:34,971 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502094971"}]},"ts":"1676502094971"} 2023-02-15 23:01:34,972 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 23:01:34,974 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:34,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 416 msec 2023-02-15 23:01:35,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 23:01:35,063 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:35,063 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:35,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:35,067 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60570, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:35,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 23:01:35,081 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:35,085 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 15 msec 2023-02-15 23:01:35,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 23:01:35,100 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:35,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-15 23:01:35,118 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 23:01:35,121 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 23:01:35,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.130sec 2023-02-15 23:01:35,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 23:01:35,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 23:01:35,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 23:01:35,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38835,1676502093892-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 23:01:35,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38835,1676502093892-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 23:01:35,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 23:01:35,186 DEBUG [Listener at localhost/36203] zookeeper.ReadOnlyZKClient(139): Connect 0x25dc3bd3 to 127.0.0.1:55667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:35,192 DEBUG [Listener at localhost/36203] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3324ed5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:35,193 DEBUG [hconnection-0x33b3acb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:35,195 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41024, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:35,196 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38835,1676502093892 2023-02-15 23:01:35,196 DEBUG [Listener at localhost/36203] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 23:01:35,198 DEBUG [Listener at localhost/36203] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 23:01:35,201 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36436, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 23:01:35,201 INFO [Listener at localhost/36203] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-15 23:01:35,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-15 23:01:35,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 23:01:35,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:36436 deadline: 1676502155202, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-15 23:01:35,203 INFO [Listener at localhost/36203] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-15 23:01:35,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:35,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:35,207 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:35,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-15 23:01:35,208 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:35,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:35,215 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:35,215 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:35,215 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:35,216 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:35,216 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:35,216 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:35,216 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:35,216 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:35,216 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0 empty. 2023-02-15 23:01:35,216 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf empty. 2023-02-15 23:01:35,216 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f empty. 2023-02-15 23:01:35,217 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a empty. 2023-02-15 23:01:35,217 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:35,217 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:35,217 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee empty. 2023-02-15 23:01:35,217 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3 empty. 2023-02-15 23:01:35,217 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a empty. 2023-02-15 23:01:35,217 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:35,217 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:35,217 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971 empty. 2023-02-15 23:01:35,218 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:35,218 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:35,218 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:35,218 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7 empty. 2023-02-15 23:01:35,218 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d empty. 2023-02-15 23:01:35,218 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:35,218 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:35,218 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:35,218 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:35,218 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:35,218 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-15 23:01:35,227 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:35,229 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => e45ebaf46b12dc5f0978933ed3e5d2d0, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp 2023-02-15 23:01:35,229 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9be0ccb017aa72d71b3f6f2b4d528bbf, NAME => 'testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp 2023-02-15 23:01:35,229 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => ef17769adbcffd4b9e090a0403e7dd4a, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp 2023-02-15 23:01:35,252 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,252 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,252 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 9be0ccb017aa72d71b3f6f2b4d528bbf, disabling compactions & flushes 2023-02-15 23:01:35,252 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing e45ebaf46b12dc5f0978933ed3e5d2d0, disabling compactions & flushes 2023-02-15 23:01:35,253 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:35,253 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:35,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:35,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. after waiting 0 ms 2023-02-15 23:01:35,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:35,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:35,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. after waiting 0 ms 2023-02-15 23:01:35,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:35,253 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:35,253 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:35,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for e45ebaf46b12dc5f0978933ed3e5d2d0: 2023-02-15 23:01:35,253 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 9be0ccb017aa72d71b3f6f2b4d528bbf: 2023-02-15 23:01:35,254 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => c5529c81671502769bca83930b3ef9c3, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp 2023-02-15 23:01:35,254 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => ef42f0baedb02ca105755e274e954d6a, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp 2023-02-15 23:01:35,254 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,254 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing ef17769adbcffd4b9e090a0403e7dd4a, disabling compactions & flushes 2023-02-15 23:01:35,255 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:35,255 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:35,255 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. after waiting 0 ms 2023-02-15 23:01:35,255 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:35,255 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:35,255 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for ef17769adbcffd4b9e090a0403e7dd4a: 2023-02-15 23:01:35,255 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 34fc5c64f675227c7d2471a10e261971, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp 2023-02-15 23:01:35,266 INFO [RS:1;jenkins-hbase4:37411] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37411%2C1676502093966, suffix=, logDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/WALs/jenkins-hbase4.apache.org,37411,1676502093966, archiveDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/oldWALs, maxLogs=32 2023-02-15 23:01:35,273 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,273 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 34fc5c64f675227c7d2471a10e261971, disabling compactions & flushes 2023-02-15 23:01:35,273 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:35,273 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:35,273 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. after waiting 0 ms 2023-02-15 23:01:35,273 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:35,273 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:35,273 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 34fc5c64f675227c7d2471a10e261971: 2023-02-15 23:01:35,274 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 498f2da6b4a7b12b99403e474e841cee, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp 2023-02-15 23:01:35,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing c5529c81671502769bca83930b3ef9c3, disabling compactions & flushes 2023-02-15 23:01:35,275 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:35,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:35,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. after waiting 0 ms 2023-02-15 23:01:35,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:35,275 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:35,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for c5529c81671502769bca83930b3ef9c3: 2023-02-15 23:01:35,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing ef42f0baedb02ca105755e274e954d6a, disabling compactions & flushes 2023-02-15 23:01:35,275 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:35,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:35,275 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => ba3aee43e72569c4a8cb9c546efb6f3f, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp 2023-02-15 23:01:35,275 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. after waiting 0 ms 2023-02-15 23:01:35,276 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:35,276 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:35,276 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for ef42f0baedb02ca105755e274e954d6a: 2023-02-15 23:01:35,276 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => e81ac83dd74dda68998ba3892f54397d, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp 2023-02-15 23:01:35,284 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34913,DS-9fc892a1-83b4-4c52-89c1-449a68477bee,DISK] 2023-02-15 23:01:35,284 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36503,DS-0d7ea8b9-4922-426e-a051-253e97aa51de,DISK] 2023-02-15 23:01:35,299 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,299 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing ba3aee43e72569c4a8cb9c546efb6f3f, disabling compactions & flushes 2023-02-15 23:01:35,299 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,299 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:35,299 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 498f2da6b4a7b12b99403e474e841cee, disabling compactions & flushes 2023-02-15 23:01:35,299 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:35,300 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:35,300 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:35,300 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. after waiting 0 ms 2023-02-15 23:01:35,300 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:35,300 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:35,300 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. after waiting 0 ms 2023-02-15 23:01:35,300 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:35,300 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 498f2da6b4a7b12b99403e474e841cee: 2023-02-15 23:01:35,300 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:35,300 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for ba3aee43e72569c4a8cb9c546efb6f3f: 2023-02-15 23:01:35,301 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 94714b23b200be2464cbfd2bde7728e7, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp 2023-02-15 23:01:35,301 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,301 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing e81ac83dd74dda68998ba3892f54397d, disabling compactions & flushes 2023-02-15 23:01:35,301 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:35,301 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:35,301 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. after waiting 0 ms 2023-02-15 23:01:35,301 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:35,302 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:35,302 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for e81ac83dd74dda68998ba3892f54397d: 2023-02-15 23:01:35,302 INFO [RS:1;jenkins-hbase4:37411] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/WALs/jenkins-hbase4.apache.org,37411,1676502093966/jenkins-hbase4.apache.org%2C37411%2C1676502093966.1676502095266 2023-02-15 23:01:35,302 DEBUG [RS:1;jenkins-hbase4:37411] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34913,DS-9fc892a1-83b4-4c52-89c1-449a68477bee,DISK], DatanodeInfoWithStorage[127.0.0.1:36503,DS-0d7ea8b9-4922-426e-a051-253e97aa51de,DISK]] 2023-02-15 23:01:35,309 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,310 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 94714b23b200be2464cbfd2bde7728e7, disabling compactions & flushes 2023-02-15 23:01:35,310 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:35,310 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:35,310 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. after waiting 0 ms 2023-02-15 23:01:35,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:35,310 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:35,310 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:35,310 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 94714b23b200be2464cbfd2bde7728e7: 2023-02-15 23:01:35,312 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:35,313 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502095313"}]},"ts":"1676502095313"} 2023-02-15 23:01:35,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676502095313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502095313"}]},"ts":"1676502095313"} 2023-02-15 23:01:35,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502095313"}]},"ts":"1676502095313"} 2023-02-15 23:01:35,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502095313"}]},"ts":"1676502095313"} 2023-02-15 23:01:35,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502095313"}]},"ts":"1676502095313"} 2023-02-15 23:01:35,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502095313"}]},"ts":"1676502095313"} 2023-02-15 23:01:35,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502095313"}]},"ts":"1676502095313"} 2023-02-15 23:01:35,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502095313"}]},"ts":"1676502095313"} 2023-02-15 23:01:35,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502095313"}]},"ts":"1676502095313"} 2023-02-15 23:01:35,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676502095313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502095313"}]},"ts":"1676502095313"} 2023-02-15 23:01:35,316 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-15 23:01:35,316 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:35,317 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502095317"}]},"ts":"1676502095317"} 2023-02-15 23:01:35,318 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-15 23:01:35,322 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:35,328 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:35,328 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:35,328 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:35,329 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9be0ccb017aa72d71b3f6f2b4d528bbf, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef17769adbcffd4b9e090a0403e7dd4a, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e45ebaf46b12dc5f0978933ed3e5d2d0, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c5529c81671502769bca83930b3ef9c3, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef42f0baedb02ca105755e274e954d6a, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34fc5c64f675227c7d2471a10e261971, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=498f2da6b4a7b12b99403e474e841cee, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba3aee43e72569c4a8cb9c546efb6f3f, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e81ac83dd74dda68998ba3892f54397d, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=94714b23b200be2464cbfd2bde7728e7, ASSIGN}] 2023-02-15 23:01:35,331 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9be0ccb017aa72d71b3f6f2b4d528bbf, ASSIGN 2023-02-15 23:01:35,331 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c5529c81671502769bca83930b3ef9c3, ASSIGN 2023-02-15 23:01:35,331 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e45ebaf46b12dc5f0978933ed3e5d2d0, ASSIGN 2023-02-15 23:01:35,331 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef17769adbcffd4b9e090a0403e7dd4a, ASSIGN 2023-02-15 23:01:35,331 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9be0ccb017aa72d71b3f6f2b4d528bbf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37799,1676502093940; forceNewPlan=false, retain=false 2023-02-15 23:01:35,331 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c5529c81671502769bca83930b3ef9c3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37411,1676502093966; forceNewPlan=false, retain=false 2023-02-15 23:01:35,332 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e45ebaf46b12dc5f0978933ed3e5d2d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37411,1676502093966; forceNewPlan=false, retain=false 2023-02-15 23:01:35,332 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef17769adbcffd4b9e090a0403e7dd4a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37411,1676502093966; forceNewPlan=false, retain=false 2023-02-15 23:01:35,332 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=94714b23b200be2464cbfd2bde7728e7, ASSIGN 2023-02-15 23:01:35,333 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e81ac83dd74dda68998ba3892f54397d, ASSIGN 2023-02-15 23:01:35,333 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba3aee43e72569c4a8cb9c546efb6f3f, ASSIGN 2023-02-15 23:01:35,333 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=498f2da6b4a7b12b99403e474e841cee, ASSIGN 2023-02-15 23:01:35,333 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34fc5c64f675227c7d2471a10e261971, ASSIGN 2023-02-15 23:01:35,334 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=94714b23b200be2464cbfd2bde7728e7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37799,1676502093940; forceNewPlan=false, retain=false 2023-02-15 23:01:35,334 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e81ac83dd74dda68998ba3892f54397d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37411,1676502093966; forceNewPlan=false, retain=false 2023-02-15 23:01:35,334 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba3aee43e72569c4a8cb9c546efb6f3f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37799,1676502093940; forceNewPlan=false, retain=false 2023-02-15 23:01:35,334 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=498f2da6b4a7b12b99403e474e841cee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37411,1676502093966; forceNewPlan=false, retain=false 2023-02-15 23:01:35,335 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34fc5c64f675227c7d2471a10e261971, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37799,1676502093940; forceNewPlan=false, retain=false 2023-02-15 23:01:35,335 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef42f0baedb02ca105755e274e954d6a, ASSIGN 2023-02-15 23:01:35,336 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef42f0baedb02ca105755e274e954d6a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37799,1676502093940; forceNewPlan=false, retain=false 2023-02-15 23:01:35,482 INFO [jenkins-hbase4:38835] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-15 23:01:35,487 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ef42f0baedb02ca105755e274e954d6a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:35,488 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ba3aee43e72569c4a8cb9c546efb6f3f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:35,488 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9be0ccb017aa72d71b3f6f2b4d528bbf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:35,488 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=94714b23b200be2464cbfd2bde7728e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:35,488 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676502095487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502095487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502095487"}]},"ts":"1676502095487"} 2023-02-15 23:01:35,488 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=34fc5c64f675227c7d2471a10e261971, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:35,488 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676502095487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502095487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502095487"}]},"ts":"1676502095487"} 2023-02-15 23:01:35,488 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502095487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502095487"}]},"ts":"1676502095487"} 2023-02-15 23:01:35,488 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502095487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502095487"}]},"ts":"1676502095487"} 2023-02-15 23:01:35,488 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502095487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502095487"}]},"ts":"1676502095487"} 2023-02-15 23:01:35,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=11, state=RUNNABLE; OpenRegionProcedure 9be0ccb017aa72d71b3f6f2b4d528bbf, server=jenkins-hbase4.apache.org,37799,1676502093940}] 2023-02-15 23:01:35,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 34fc5c64f675227c7d2471a10e261971, server=jenkins-hbase4.apache.org,37799,1676502093940}] 2023-02-15 23:01:35,492 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure 94714b23b200be2464cbfd2bde7728e7, server=jenkins-hbase4.apache.org,37799,1676502093940}] 2023-02-15 23:01:35,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE; OpenRegionProcedure ba3aee43e72569c4a8cb9c546efb6f3f, server=jenkins-hbase4.apache.org,37799,1676502093940}] 2023-02-15 23:01:35,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure ef42f0baedb02ca105755e274e954d6a, server=jenkins-hbase4.apache.org,37799,1676502093940}] 2023-02-15 23:01:35,495 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=e81ac83dd74dda68998ba3892f54397d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:35,495 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502095495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502095495"}]},"ts":"1676502095495"} 2023-02-15 23:01:35,495 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e45ebaf46b12dc5f0978933ed3e5d2d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:35,495 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502095495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502095495"}]},"ts":"1676502095495"} 2023-02-15 23:01:35,496 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=498f2da6b4a7b12b99403e474e841cee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:35,496 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c5529c81671502769bca83930b3ef9c3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:35,496 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095496"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502095496"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502095496"}]},"ts":"1676502095496"} 2023-02-15 23:01:35,496 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095496"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502095496"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502095496"}]},"ts":"1676502095496"} 2023-02-15 23:01:35,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure e81ac83dd74dda68998ba3892f54397d, server=jenkins-hbase4.apache.org,37411,1676502093966}] 2023-02-15 23:01:35,497 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ef17769adbcffd4b9e090a0403e7dd4a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:35,498 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095497"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502095497"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502095497"}]},"ts":"1676502095497"} 2023-02-15 23:01:35,498 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=13, state=RUNNABLE; OpenRegionProcedure e45ebaf46b12dc5f0978933ed3e5d2d0, server=jenkins-hbase4.apache.org,37411,1676502093966}] 2023-02-15 23:01:35,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure 498f2da6b4a7b12b99403e474e841cee, server=jenkins-hbase4.apache.org,37411,1676502093966}] 2023-02-15 23:01:35,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure c5529c81671502769bca83930b3ef9c3, server=jenkins-hbase4.apache.org,37411,1676502093966}] 2023-02-15 23:01:35,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=12, state=RUNNABLE; OpenRegionProcedure ef17769adbcffd4b9e090a0403e7dd4a, server=jenkins-hbase4.apache.org,37411,1676502093966}] 2023-02-15 23:01:35,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:35,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:35,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9be0ccb017aa72d71b3f6f2b4d528bbf, NAME => 'testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-15 23:01:35,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:35,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:35,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:35,649 INFO [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:35,650 DEBUG [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf/f1 2023-02-15 23:01:35,650 DEBUG [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf/f1 2023-02-15 23:01:35,651 INFO [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9be0ccb017aa72d71b3f6f2b4d528bbf columnFamilyName f1 2023-02-15 23:01:35,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:35,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c5529c81671502769bca83930b3ef9c3, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-15 23:01:35,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:35,651 INFO [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] regionserver.HStore(310): Store=9be0ccb017aa72d71b3f6f2b4d528bbf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:35,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:35,652 INFO [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:35,653 INFO [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:35,653 DEBUG [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf/f2 2023-02-15 23:01:35,653 DEBUG [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf/f2 2023-02-15 23:01:35,653 INFO [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9be0ccb017aa72d71b3f6f2b4d528bbf columnFamilyName f2 2023-02-15 23:01:35,654 DEBUG [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1 2023-02-15 23:01:35,654 INFO [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] regionserver.HStore(310): Store=9be0ccb017aa72d71b3f6f2b4d528bbf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,654 DEBUG [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1 2023-02-15 23:01:35,654 INFO [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5529c81671502769bca83930b3ef9c3 columnFamilyName f1 2023-02-15 23:01:35,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:35,654 INFO [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] regionserver.HStore(310): Store=c5529c81671502769bca83930b3ef9c3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,655 INFO [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:35,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:35,656 DEBUG [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2 2023-02-15 23:01:35,656 DEBUG [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2 2023-02-15 23:01:35,656 INFO [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5529c81671502769bca83930b3ef9c3 columnFamilyName f2 2023-02-15 23:01:35,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:35,657 INFO [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] regionserver.HStore(310): Store=c5529c81671502769bca83930b3ef9c3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:35,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:35,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:35,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:35,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:35,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9be0ccb017aa72d71b3f6f2b4d528bbf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60880301, jitterRate=-0.09281282126903534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:35,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9be0ccb017aa72d71b3f6f2b4d528bbf: 2023-02-15 23:01:35,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:35,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf., pid=21, masterSystemTime=1676502095643 2023-02-15 23:01:35,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:35,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:35,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:35,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:35,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 94714b23b200be2464cbfd2bde7728e7, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-15 23:01:35,663 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9be0ccb017aa72d71b3f6f2b4d528bbf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:35,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c5529c81671502769bca83930b3ef9c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63956172, jitterRate=-0.046978771686553955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:35,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c5529c81671502769bca83930b3ef9c3: 2023-02-15 23:01:35,663 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676502095662"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502095662"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502095662"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502095662"}]},"ts":"1676502095662"} 2023-02-15 23:01:35,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:35,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:35,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:35,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3., pid=29, masterSystemTime=1676502095648 2023-02-15 23:01:35,664 INFO [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:35,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:35,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:35,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:35,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e45ebaf46b12dc5f0978933ed3e5d2d0, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-15 23:01:35,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:35,666 DEBUG [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7/f1 2023-02-15 23:01:35,666 DEBUG [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7/f1 2023-02-15 23:01:35,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:35,666 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c5529c81671502769bca83930b3ef9c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:35,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:35,666 INFO [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94714b23b200be2464cbfd2bde7728e7 columnFamilyName f1 2023-02-15 23:01:35,666 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095666"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502095666"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502095666"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502095666"}]},"ts":"1676502095666"} 2023-02-15 23:01:35,666 INFO [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] regionserver.HStore(310): Store=94714b23b200be2464cbfd2bde7728e7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,667 INFO [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:35,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=11 2023-02-15 23:01:35,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=11, state=SUCCESS; OpenRegionProcedure 9be0ccb017aa72d71b3f6f2b4d528bbf, server=jenkins-hbase4.apache.org,37799,1676502093940 in 174 msec 2023-02-15 23:01:35,668 INFO [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:35,668 DEBUG [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7/f2 2023-02-15 23:01:35,668 DEBUG [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7/f2 2023-02-15 23:01:35,668 INFO [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94714b23b200be2464cbfd2bde7728e7 columnFamilyName f2 2023-02-15 23:01:35,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9be0ccb017aa72d71b3f6f2b4d528bbf, ASSIGN in 339 msec 2023-02-15 23:01:35,669 INFO [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] regionserver.HStore(310): Store=94714b23b200be2464cbfd2bde7728e7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,669 DEBUG [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1 2023-02-15 23:01:35,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-15 23:01:35,669 DEBUG [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1 2023-02-15 23:01:35,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure c5529c81671502769bca83930b3ef9c3, server=jenkins-hbase4.apache.org,37411,1676502093966 in 168 msec 2023-02-15 23:01:35,669 INFO [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e45ebaf46b12dc5f0978933ed3e5d2d0 columnFamilyName f1 2023-02-15 23:01:35,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:35,670 INFO [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] regionserver.HStore(310): Store=e45ebaf46b12dc5f0978933ed3e5d2d0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,670 INFO [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:35,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:35,670 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c5529c81671502769bca83930b3ef9c3, ASSIGN in 341 msec 2023-02-15 23:01:35,671 DEBUG [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2 2023-02-15 23:01:35,671 DEBUG [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2 2023-02-15 23:01:35,671 INFO [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e45ebaf46b12dc5f0978933ed3e5d2d0 columnFamilyName f2 2023-02-15 23:01:35,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:35,672 INFO [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] regionserver.HStore(310): Store=e45ebaf46b12dc5f0978933ed3e5d2d0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:35,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:35,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:35,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:35,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:35,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 94714b23b200be2464cbfd2bde7728e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68063409, jitterRate=0.014223828911781311}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:35,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 94714b23b200be2464cbfd2bde7728e7: 2023-02-15 23:01:35,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7., pid=23, masterSystemTime=1676502095643 2023-02-15 23:01:35,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:35,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:35,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:35,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:35,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ef42f0baedb02ca105755e274e954d6a, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-15 23:01:35,677 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=94714b23b200be2464cbfd2bde7728e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:35,677 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676502095677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502095677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502095677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502095677"}]},"ts":"1676502095677"} 2023-02-15 23:01:35,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:35,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:35,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:35,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:35,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e45ebaf46b12dc5f0978933ed3e5d2d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73054976, jitterRate=0.08860397338867188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:35,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e45ebaf46b12dc5f0978933ed3e5d2d0: 2023-02-15 23:01:35,678 INFO [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:35,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0., pid=27, masterSystemTime=1676502095648 2023-02-15 23:01:35,679 DEBUG [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1 2023-02-15 23:01:35,679 DEBUG [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1 2023-02-15 23:01:35,680 INFO [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef42f0baedb02ca105755e274e954d6a columnFamilyName f1 2023-02-15 23:01:35,680 INFO [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] regionserver.HStore(310): Store=ef42f0baedb02ca105755e274e954d6a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,680 INFO [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:35,681 DEBUG [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2 2023-02-15 23:01:35,681 DEBUG [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2 2023-02-15 23:01:35,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:35,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:35,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:35,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-15 23:01:35,682 INFO [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef42f0baedb02ca105755e274e954d6a columnFamilyName f2 2023-02-15 23:01:35,682 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e45ebaf46b12dc5f0978933ed3e5d2d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:35,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure 94714b23b200be2464cbfd2bde7728e7, server=jenkins-hbase4.apache.org,37799,1676502093940 in 186 msec 2023-02-15 23:01:35,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ef17769adbcffd4b9e090a0403e7dd4a, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-15 23:01:35,682 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095682"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502095682"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502095682"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502095682"}]},"ts":"1676502095682"} 2023-02-15 23:01:35,682 INFO [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] regionserver.HStore(310): Store=ef42f0baedb02ca105755e274e954d6a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:35,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:35,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:35,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=94714b23b200be2464cbfd2bde7728e7, ASSIGN in 353 msec 2023-02-15 23:01:35,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:35,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:35,683 INFO [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:35,684 DEBUG [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1 2023-02-15 23:01:35,684 DEBUG [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1 2023-02-15 23:01:35,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=13 2023-02-15 23:01:35,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=13, state=SUCCESS; OpenRegionProcedure e45ebaf46b12dc5f0978933ed3e5d2d0, server=jenkins-hbase4.apache.org,37411,1676502093966 in 185 msec 2023-02-15 23:01:35,685 INFO [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef17769adbcffd4b9e090a0403e7dd4a columnFamilyName f1 2023-02-15 23:01:35,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:35,685 INFO [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] regionserver.HStore(310): Store=ef17769adbcffd4b9e090a0403e7dd4a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,685 INFO [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:35,685 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e45ebaf46b12dc5f0978933ed3e5d2d0, ASSIGN in 356 msec 2023-02-15 23:01:35,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:35,686 DEBUG [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2 2023-02-15 23:01:35,686 DEBUG [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2 2023-02-15 23:01:35,686 INFO [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef17769adbcffd4b9e090a0403e7dd4a columnFamilyName f2 2023-02-15 23:01:35,687 INFO [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] regionserver.HStore(310): Store=ef17769adbcffd4b9e090a0403e7dd4a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:35,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:35,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:35,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ef42f0baedb02ca105755e274e954d6a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75348203, jitterRate=0.12277571856975555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:35,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ef42f0baedb02ca105755e274e954d6a: 2023-02-15 23:01:35,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a., pid=25, masterSystemTime=1676502095643 2023-02-15 23:01:35,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:35,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:35,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:35,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 34fc5c64f675227c7d2471a10e261971, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-15 23:01:35,690 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ef42f0baedb02ca105755e274e954d6a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:35,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:35,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,690 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095690"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502095690"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502095690"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502095690"}]},"ts":"1676502095690"} 2023-02-15 23:01:35,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:35,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:35,692 INFO [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:35,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-15 23:01:35,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure ef42f0baedb02ca105755e274e954d6a, server=jenkins-hbase4.apache.org,37799,1676502093940 in 198 msec 2023-02-15 23:01:35,693 DEBUG [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1 2023-02-15 23:01:35,693 DEBUG [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1 2023-02-15 23:01:35,693 INFO [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34fc5c64f675227c7d2471a10e261971 columnFamilyName f1 2023-02-15 23:01:35,694 INFO [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] regionserver.HStore(310): Store=34fc5c64f675227c7d2471a10e261971/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef42f0baedb02ca105755e274e954d6a, ASSIGN in 365 msec 2023-02-15 23:01:35,694 INFO [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:35,695 DEBUG [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2 2023-02-15 23:01:35,695 DEBUG [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2 2023-02-15 23:01:35,695 INFO [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34fc5c64f675227c7d2471a10e261971 columnFamilyName f2 2023-02-15 23:01:35,698 INFO [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] regionserver.HStore(310): Store=34fc5c64f675227c7d2471a10e261971/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:35,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:35,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:35,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:35,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:35,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:35,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:35,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:35,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ef17769adbcffd4b9e090a0403e7dd4a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62691042, jitterRate=-0.06583067774772644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:35,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 34fc5c64f675227c7d2471a10e261971; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60976899, jitterRate=-0.09137339890003204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:35,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ef17769adbcffd4b9e090a0403e7dd4a: 2023-02-15 23:01:35,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 34fc5c64f675227c7d2471a10e261971: 2023-02-15 23:01:35,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a., pid=30, masterSystemTime=1676502095648 2023-02-15 23:01:35,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971., pid=22, masterSystemTime=1676502095643 2023-02-15 23:01:35,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:35,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:35,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:35,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ba3aee43e72569c4a8cb9c546efb6f3f, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-15 23:01:35,706 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=34fc5c64f675227c7d2471a10e261971, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:35,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:35,706 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095706"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502095706"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502095706"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502095706"}]},"ts":"1676502095706"} 2023-02-15 23:01:35,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:35,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:35,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:35,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:35,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:35,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e81ac83dd74dda68998ba3892f54397d, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-15 23:01:35,707 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ef17769adbcffd4b9e090a0403e7dd4a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:35,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:35,707 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095707"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502095707"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502095707"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502095707"}]},"ts":"1676502095707"} 2023-02-15 23:01:35,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:35,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:35,708 INFO [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:35,709 INFO [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:35,710 DEBUG [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1 2023-02-15 23:01:35,710 DEBUG [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1 2023-02-15 23:01:35,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-15 23:01:35,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 34fc5c64f675227c7d2471a10e261971, server=jenkins-hbase4.apache.org,37799,1676502093940 in 217 msec 2023-02-15 23:01:35,710 INFO [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba3aee43e72569c4a8cb9c546efb6f3f columnFamilyName f1 2023-02-15 23:01:35,711 INFO [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] regionserver.HStore(310): Store=ba3aee43e72569c4a8cb9c546efb6f3f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,711 INFO [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:35,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=12 2023-02-15 23:01:35,711 DEBUG [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1 2023-02-15 23:01:35,711 DEBUG [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1 2023-02-15 23:01:35,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=12, state=SUCCESS; OpenRegionProcedure ef17769adbcffd4b9e090a0403e7dd4a, server=jenkins-hbase4.apache.org,37411,1676502093966 in 209 msec 2023-02-15 23:01:35,711 INFO [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e81ac83dd74dda68998ba3892f54397d columnFamilyName f1 2023-02-15 23:01:35,712 INFO [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] regionserver.HStore(310): Store=e81ac83dd74dda68998ba3892f54397d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,712 INFO [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:35,712 DEBUG [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2 2023-02-15 23:01:35,712 DEBUG [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2 2023-02-15 23:01:35,712 INFO [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba3aee43e72569c4a8cb9c546efb6f3f columnFamilyName f2 2023-02-15 23:01:35,713 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef17769adbcffd4b9e090a0403e7dd4a, ASSIGN in 383 msec 2023-02-15 23:01:35,713 INFO [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] regionserver.HStore(310): Store=ba3aee43e72569c4a8cb9c546efb6f3f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34fc5c64f675227c7d2471a10e261971, ASSIGN in 382 msec 2023-02-15 23:01:35,714 DEBUG [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2 2023-02-15 23:01:35,714 DEBUG [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2 2023-02-15 23:01:35,714 INFO [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e81ac83dd74dda68998ba3892f54397d columnFamilyName f2 2023-02-15 23:01:35,715 INFO [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] regionserver.HStore(310): Store=e81ac83dd74dda68998ba3892f54397d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:35,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:35,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:35,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:35,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:35,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:35,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e81ac83dd74dda68998ba3892f54397d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67612842, jitterRate=0.007509857416152954}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:35,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:35,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e81ac83dd74dda68998ba3892f54397d: 2023-02-15 23:01:35,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d., pid=26, masterSystemTime=1676502095648 2023-02-15 23:01:35,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:35,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:35,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:35,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 498f2da6b4a7b12b99403e474e841cee, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-15 23:01:35,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:35,723 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=e81ac83dd74dda68998ba3892f54397d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:35,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:35,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:35,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:35,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:35,724 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095723"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502095723"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502095723"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502095723"}]},"ts":"1676502095723"} 2023-02-15 23:01:35,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:35,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-15 23:01:35,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure e81ac83dd74dda68998ba3892f54397d, server=jenkins-hbase4.apache.org,37411,1676502093966 in 229 msec 2023-02-15 23:01:35,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e81ac83dd74dda68998ba3892f54397d, ASSIGN in 397 msec 2023-02-15 23:01:35,732 INFO [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:35,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:35,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ba3aee43e72569c4a8cb9c546efb6f3f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64944873, jitterRate=-0.032245978713035583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:35,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ba3aee43e72569c4a8cb9c546efb6f3f: 2023-02-15 23:01:35,733 DEBUG [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1 2023-02-15 23:01:35,734 DEBUG [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1 2023-02-15 23:01:35,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f., pid=24, masterSystemTime=1676502095643 2023-02-15 23:01:35,734 INFO [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 498f2da6b4a7b12b99403e474e841cee columnFamilyName f1 2023-02-15 23:01:35,735 INFO [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] regionserver.HStore(310): Store=498f2da6b4a7b12b99403e474e841cee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,735 INFO [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:35,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:35,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:35,735 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ba3aee43e72569c4a8cb9c546efb6f3f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:35,735 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095735"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502095735"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502095735"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502095735"}]},"ts":"1676502095735"} 2023-02-15 23:01:35,736 DEBUG [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2 2023-02-15 23:01:35,736 DEBUG [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2 2023-02-15 23:01:35,737 INFO [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 498f2da6b4a7b12b99403e474e841cee columnFamilyName f2 2023-02-15 23:01:35,737 INFO [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] regionserver.HStore(310): Store=498f2da6b4a7b12b99403e474e841cee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:35,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:35,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-02-15 23:01:35,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:35,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; OpenRegionProcedure ba3aee43e72569c4a8cb9c546efb6f3f, server=jenkins-hbase4.apache.org,37799,1676502093940 in 244 msec 2023-02-15 23:01:35,739 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba3aee43e72569c4a8cb9c546efb6f3f, ASSIGN in 409 msec 2023-02-15 23:01:35,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:35,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:35,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:35,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 498f2da6b4a7b12b99403e474e841cee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68367653, jitterRate=0.018757417798042297}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:35,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 498f2da6b4a7b12b99403e474e841cee: 2023-02-15 23:01:35,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee., pid=28, masterSystemTime=1676502095648 2023-02-15 23:01:35,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:35,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:35,744 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=498f2da6b4a7b12b99403e474e841cee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:35,745 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502095744"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502095744"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502095744"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502095744"}]},"ts":"1676502095744"} 2023-02-15 23:01:35,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-15 23:01:35,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure 498f2da6b4a7b12b99403e474e841cee, server=jenkins-hbase4.apache.org,37411,1676502093966 in 247 msec 2023-02-15 23:01:35,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-15 23:01:35,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=498f2da6b4a7b12b99403e474e841cee, ASSIGN in 419 msec 2023-02-15 23:01:35,749 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:35,749 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502095749"}]},"ts":"1676502095749"} 2023-02-15 23:01:35,750 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-15 23:01:35,752 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:35,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 547 msec 2023-02-15 23:01:35,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:35,813 INFO [Listener at localhost/36203] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-15 23:01:35,813 DEBUG [Listener at localhost/36203] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-15 23:01:35,813 INFO [Listener at localhost/36203] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:35,816 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-15 23:01:35,817 INFO [Listener at localhost/36203] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:35,817 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-15 23:01:35,817 INFO [Listener at localhost/36203] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 23:01:35,853 DEBUG [hconnection-0x33b3acb-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:35,862 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60584, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:35,868 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37799] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:35,873 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37411] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:35,994 INFO [Listener at localhost/36203] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 23:01:35,995 INFO [Listener at localhost/36203] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 23:01:35,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-15 23:01:35,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676502095996 (current time:1676502095996). 2023-02-15 23:01:35,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 23:01:35,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] zookeeper.ReadOnlyZKClient(139): Connect 0x6cfa1640 to 127.0.0.1:55667 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:36,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ed37cec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:36,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:36,004 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41036, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:36,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cfa1640 to 127.0.0.1:55667 2023-02-15 23:01:36,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:36,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 23:01:36,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-15 23:01:36,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-15 23:01:36,008 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-15 23:01:36,008 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676502696008 2023-02-15 23:01:36,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-15 23:01:36,009 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,009 DEBUG [Listener at localhost/36203] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:36,010 DEBUG [Listener at localhost/36203] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 23:01:36,010 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-15 23:01:36,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-15 23:01:36,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 4 msec 2023-02-15 23:01:36,012 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-15 23:01:36,012 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676502696012 2023-02-15 23:01:36,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,030 INFO [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-15 23:01:36,030 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:36,031 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-15 23:01:36,031 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-15 23:01:36,031 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,031 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,033 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,033 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:36,033 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:36,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:36,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:36,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:36,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:36,033 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,033 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,035 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,035 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:36,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-15 23:01:36,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,036 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-15 23:01:36,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-15 23:01:36,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,036 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-15 23:01:36,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,036 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-15 23:01:36,036 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:36,039 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 23:01:36,039 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-15 23:01:36,039 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:36,039 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 23:01:36,039 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 23:01:36,039 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 23:01:36,039 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37799,1676502093940' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 23:01:36,039 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37411,1676502093966' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 23:01:36,041 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,041 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:36,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:36,042 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,042 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,042 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:36,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:36,042 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,042 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,042 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:36,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:36,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:36,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37799,1676502093940' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 23:01:36,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4df21cd6[Count = 1] remaining members to acquire global barrier 2023-02-15 23:01:36,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:36,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:36,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:36,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:36,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:36,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37411,1676502093966' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 23:01:36,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4df21cd6[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:36,046 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-15 23:01:36,046 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,048 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,048 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,049 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 23:01:36,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,049 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 23:01:36,049 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,049 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:36,049 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. started... 2023-02-15 23:01:36,049 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:36,049 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. started... 2023-02-15 23:01:36,049 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,050 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:36,050 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 94714b23b200be2464cbfd2bde7728e7: 2023-02-15 23:01:36,050 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. started... 2023-02-15 23:01:36,050 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:36,050 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,052 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 23:01:36,052 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 23:01:36,053 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:36,052 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e45ebaf46b12dc5f0978933ed3e5d2d0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:36,052 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:36,052 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e81ac83dd74dda68998ba3892f54397d 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 23:01:36,052 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:36,053 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. started... 2023-02-15 23:01:36,053 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. started... 2023-02-15 23:01:36,053 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:36,053 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 34fc5c64f675227c7d2471a10e261971 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:36,054 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c5529c81671502769bca83930b3ef9c3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:36,053 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 23:01:36,053 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 23:01:36,053 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. started... 2023-02-15 23:01:36,053 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 23:01:36,055 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] regionserver.HRegion(2744): Flushing ba3aee43e72569c4a8cb9c546efb6f3f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:36,055 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 23:01:36,086 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. completed. 2023-02-15 23:01:36,087 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:36,087 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:36,087 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. started... 2023-02-15 23:01:36,087 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/.tmp/f1/a6be041e73d442569bd9e486f3944159 2023-02-15 23:01:36,087 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 23:01:36,092 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/.tmp/f1/9fcdc046e58f4704abae6366e56e8bff 2023-02-15 23:01:36,092 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/.tmp/f1/4f5d9a180b984409a6f588c47f644592 2023-02-15 23:01:36,093 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/.tmp/f1/b6cdcd3da38f425490f508082443ed32 2023-02-15 23:01:36,094 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ef42f0baedb02ca105755e274e954d6a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:36,102 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/.tmp/f1/c8e43fdea77f46258026d286581bfa58 2023-02-15 23:01:36,110 DEBUG [Listener at localhost/36203] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:36,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 23:01:36,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 23:01:36,112 DEBUG [Listener at localhost/36203] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 23:01:36,134 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/.tmp/f2/7b53773e4b024a66be576d1413bc9098 2023-02-15 23:01:36,140 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/.tmp/f1/a6be041e73d442569bd9e486f3944159 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1/a6be041e73d442569bd9e486f3944159 2023-02-15 23:01:36,145 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1/a6be041e73d442569bd9e486f3944159, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:36,146 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/.tmp/f2/7b53773e4b024a66be576d1413bc9098 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2/7b53773e4b024a66be576d1413bc9098 2023-02-15 23:01:36,154 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2/7b53773e4b024a66be576d1413bc9098, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:36,155 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e45ebaf46b12dc5f0978933ed3e5d2d0 in 103ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:36,155 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-15 23:01:36,155 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e45ebaf46b12dc5f0978933ed3e5d2d0: 2023-02-15 23:01:36,156 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,165 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:36,166 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1/a6be041e73d442569bd9e486f3944159] hfiles 2023-02-15 23:01:36,166 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1/a6be041e73d442569bd9e486f3944159 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,166 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2/7b53773e4b024a66be576d1413bc9098] hfiles 2023-02-15 23:01:36,166 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2/7b53773e4b024a66be576d1413bc9098 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,167 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/.tmp/f2/5b0b4db82f30479d8f770fddbe8cfdef 2023-02-15 23:01:36,175 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/.tmp/f2/7fd4aa6baf10477bacd9ea35dd5d83e2 2023-02-15 23:01:36,175 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/.tmp/f2/d16d5f87336844a0a6b149a83430d7af 2023-02-15 23:01:36,180 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/.tmp/f1/b6cdcd3da38f425490f508082443ed32 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1/b6cdcd3da38f425490f508082443ed32 2023-02-15 23:01:36,184 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1/b6cdcd3da38f425490f508082443ed32, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 23:01:36,184 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/.tmp/f2/d72da46bfe714aa88b7d6ef622feb6c1 2023-02-15 23:01:36,186 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/.tmp/f1/f638714f241542b286665476223e67e8 2023-02-15 23:01:36,186 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/.tmp/f2/d16d5f87336844a0a6b149a83430d7af as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2/d16d5f87336844a0a6b149a83430d7af 2023-02-15 23:01:36,188 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/.tmp/f1/9fcdc046e58f4704abae6366e56e8bff as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1/9fcdc046e58f4704abae6366e56e8bff 2023-02-15 23:01:36,188 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/.tmp/f1/c8e43fdea77f46258026d286581bfa58 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1/c8e43fdea77f46258026d286581bfa58 2023-02-15 23:01:36,195 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1/c8e43fdea77f46258026d286581bfa58, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:36,196 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/.tmp/f2/5b0b4db82f30479d8f770fddbe8cfdef as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2/5b0b4db82f30479d8f770fddbe8cfdef 2023-02-15 23:01:36,197 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1/9fcdc046e58f4704abae6366e56e8bff, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:36,197 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/.tmp/f2/7fd4aa6baf10477bacd9ea35dd5d83e2 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2/7fd4aa6baf10477bacd9ea35dd5d83e2 2023-02-15 23:01:36,204 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. completed. 2023-02-15 23:01:36,204 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:36,204 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:36,204 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 23:01:36,204 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. started... 2023-02-15 23:01:36,205 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2/7fd4aa6baf10477bacd9ea35dd5d83e2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:36,206 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c5529c81671502769bca83930b3ef9c3 in 152ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:36,206 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/.tmp/f1/4f5d9a180b984409a6f588c47f644592 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1/4f5d9a180b984409a6f588c47f644592 2023-02-15 23:01:36,210 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1/4f5d9a180b984409a6f588c47f644592, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:36,210 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/.tmp/f2/d72da46bfe714aa88b7d6ef622feb6c1 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2/d72da46bfe714aa88b7d6ef622feb6c1 2023-02-15 23:01:36,213 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c5529c81671502769bca83930b3ef9c3: 2023-02-15 23:01:36,213 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 498f2da6b4a7b12b99403e474e841cee 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 23:01:36,213 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,213 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:36,213 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1/9fcdc046e58f4704abae6366e56e8bff] hfiles 2023-02-15 23:01:36,213 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1/9fcdc046e58f4704abae6366e56e8bff for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,213 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2/7fd4aa6baf10477bacd9ea35dd5d83e2] hfiles 2023-02-15 23:01:36,213 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2/7fd4aa6baf10477bacd9ea35dd5d83e2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,214 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2/d16d5f87336844a0a6b149a83430d7af, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 23:01:36,216 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e81ac83dd74dda68998ba3892f54397d in 164ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:36,216 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e81ac83dd74dda68998ba3892f54397d: 2023-02-15 23:01:36,216 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2/5b0b4db82f30479d8f770fddbe8cfdef, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:36,216 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,216 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:36,216 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1/b6cdcd3da38f425490f508082443ed32] hfiles 2023-02-15 23:01:36,217 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1/b6cdcd3da38f425490f508082443ed32 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,217 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2/d16d5f87336844a0a6b149a83430d7af] hfiles 2023-02-15 23:01:36,217 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2/d16d5f87336844a0a6b149a83430d7af for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,217 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 34fc5c64f675227c7d2471a10e261971 in 164ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:36,217 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 34fc5c64f675227c7d2471a10e261971: 2023-02-15 23:01:36,217 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,217 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:36,217 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1/c8e43fdea77f46258026d286581bfa58] hfiles 2023-02-15 23:01:36,217 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1/c8e43fdea77f46258026d286581bfa58 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,217 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2/5b0b4db82f30479d8f770fddbe8cfdef] hfiles 2023-02-15 23:01:36,217 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2/5b0b4db82f30479d8f770fddbe8cfdef for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,220 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2/d72da46bfe714aa88b7d6ef622feb6c1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:36,221 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ba3aee43e72569c4a8cb9c546efb6f3f in 166ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:36,221 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ba3aee43e72569c4a8cb9c546efb6f3f: 2023-02-15 23:01:36,222 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,222 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:36,222 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1/4f5d9a180b984409a6f588c47f644592] hfiles 2023-02-15 23:01:36,222 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1/4f5d9a180b984409a6f588c47f644592 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,222 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2/d72da46bfe714aa88b7d6ef622feb6c1] hfiles 2023-02-15 23:01:36,222 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2/d72da46bfe714aa88b7d6ef622feb6c1 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,232 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/.tmp/f2/b7d1b17519214fcaa756ee2a3a9aa812 2023-02-15 23:01:36,252 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/.tmp/f1/0dd2074330b249aaa233659df5517561 2023-02-15 23:01:36,260 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. completed. 2023-02-15 23:01:36,260 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:36,260 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:36,260 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 23:01:36,260 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. started... 2023-02-15 23:01:36,262 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ef17769adbcffd4b9e090a0403e7dd4a 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 23:01:36,262 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. completed. 2023-02-15 23:01:36,262 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:36,262 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. completed. 2023-02-15 23:01:36,262 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 23:01:36,262 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:36,262 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. started... 2023-02-15 23:01:36,262 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:36,262 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 23:01:36,263 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. completed. 2023-02-15 23:01:36,263 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 9be0ccb017aa72d71b3f6f2b4d528bbf: 2023-02-15 23:01:36,264 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:36,264 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 23:01:36,264 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,264 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:36,264 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 23:01:36,264 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 23:01:36,265 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/.tmp/f1/f638714f241542b286665476223e67e8 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1/f638714f241542b286665476223e67e8 2023-02-15 23:01:36,277 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1/f638714f241542b286665476223e67e8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:36,277 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/.tmp/f2/b7d1b17519214fcaa756ee2a3a9aa812 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2/b7d1b17519214fcaa756ee2a3a9aa812 2023-02-15 23:01:36,282 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2/b7d1b17519214fcaa756ee2a3a9aa812, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:36,283 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ef42f0baedb02ca105755e274e954d6a in 189ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:36,283 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ef42f0baedb02ca105755e274e954d6a: 2023-02-15 23:01:36,283 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,283 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:36,283 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1/f638714f241542b286665476223e67e8] hfiles 2023-02-15 23:01:36,283 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1/f638714f241542b286665476223e67e8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,283 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2/b7d1b17519214fcaa756ee2a3a9aa812] hfiles 2023-02-15 23:01:36,283 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2/b7d1b17519214fcaa756ee2a3a9aa812 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,300 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/.tmp/f1/0236955c4d294001889da562884bac4a 2023-02-15 23:01:36,300 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. completed. 2023-02-15 23:01:36,300 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:36,300 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 23:01:36,308 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/.tmp/f2/252321992d4245be8205ed532afde168 2023-02-15 23:01:36,312 DEBUG [Listener at localhost/36203] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:36,314 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/.tmp/f1/0dd2074330b249aaa233659df5517561 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1/0dd2074330b249aaa233659df5517561 2023-02-15 23:01:36,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 23:01:36,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 23:01:36,315 DEBUG [Listener at localhost/36203] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-15 23:01:36,325 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1/0dd2074330b249aaa233659df5517561, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:36,326 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/.tmp/f2/252321992d4245be8205ed532afde168 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2/252321992d4245be8205ed532afde168 2023-02-15 23:01:36,326 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. completed. 2023-02-15 23:01:36,326 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:36,326 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 23:01:36,326 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 23:01:36,326 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,326 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 23:01:36,326 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,37799,1676502093940' in zk 2023-02-15 23:01:36,328 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/.tmp/f2/0e4b2c171a6b4b4e9325a9aff067f8eb 2023-02-15 23:01:36,329 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,329 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 23:01:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:36,329 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:36,329 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 23:01:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:36,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:36,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:36,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,332 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2/252321992d4245be8205ed532afde168, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 23:01:36,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,333 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/.tmp/f1/0236955c4d294001889da562884bac4a as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1/0236955c4d294001889da562884bac4a 2023-02-15 23:01:36,333 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 498f2da6b4a7b12b99403e474e841cee in 120ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,37799,1676502093940': 2023-02-15 23:01:36,333 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 498f2da6b4a7b12b99403e474e841cee: 2023-02-15 23:01:36,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37799,1676502093940' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 23:01:36,333 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,333 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:36,333 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1/0dd2074330b249aaa233659df5517561] hfiles 2023-02-15 23:01:36,334 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1/0dd2074330b249aaa233659df5517561 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,334 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2/252321992d4245be8205ed532afde168] hfiles 2023-02-15 23:01:36,334 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2/252321992d4245be8205ed532afde168 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,337 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1/0236955c4d294001889da562884bac4a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 23:01:36,338 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/.tmp/f2/0e4b2c171a6b4b4e9325a9aff067f8eb as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2/0e4b2c171a6b4b4e9325a9aff067f8eb 2023-02-15 23:01:36,342 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2/0e4b2c171a6b4b4e9325a9aff067f8eb, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 23:01:36,343 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ef17769adbcffd4b9e090a0403e7dd4a in 81ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:36,343 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ef17769adbcffd4b9e090a0403e7dd4a: 2023-02-15 23:01:36,343 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,343 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:36,343 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1/0236955c4d294001889da562884bac4a] hfiles 2023-02-15 23:01:36,343 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1/0236955c4d294001889da562884bac4a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,343 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2/0e4b2c171a6b4b4e9325a9aff067f8eb] hfiles 2023-02-15 23:01:36,343 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2/0e4b2c171a6b4b4e9325a9aff067f8eb for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,348 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. completed. 2023-02-15 23:01:36,348 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:36,348 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 23:01:36,358 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. completed. 2023-02-15 23:01:36,358 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:36,358 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 23:01:36,358 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 23:01:36,358 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,358 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 23:01:36,358 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,37411,1676502093966' in zk 2023-02-15 23:01:36,360 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 23:01:36,360 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,360 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,360 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 23:01:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:36,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:36,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:36,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,37411,1676502093966': 2023-02-15 23:01:36,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37411,1676502093966' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 23:01:36,363 INFO [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-15 23:01:36,363 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:36,363 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:36,363 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,363 INFO [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 23:01:36,366 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,366 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,366 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,366 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:36,366 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:36,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:36,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:36,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,366 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:36,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:36,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:36,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:36,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:36,367 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:36,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,368 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:36,369 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,377 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,377 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:36,377 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:36,377 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:36,377 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:36,377 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:36,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,377 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:36,377 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:36,377 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:36,377 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,377 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,378 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,378 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,378 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,378 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:36,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:36,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:36,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:36,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-15 23:01:36,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,457 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676502096009Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676502096377 (+368 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676502096377Writing data manifest for testWithMockedMapReduceMultiRegion at 1676502096399 (+22 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676502096424 (+25 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676502096457 (+33 ms) 2023-02-15 23:01:36,459 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-15 23:01:36,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 450 msec 2023-02-15 23:01:36,615 DEBUG [Listener at localhost/36203] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:36,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 23:01:36,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 23:01:36,617 INFO [Listener at localhost/36203] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 23:01:36,621 INFO [Listener at localhost/36203] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 23:01:36,627 INFO [Listener at localhost/36203] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 23:01:36,655 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37799] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:36,662 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37411] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:36,748 INFO [Listener at localhost/36203] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 23:01:36,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 23:01:36,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,756 INFO [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-15 23:01:36,756 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:36,757 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-15 23:01:36,757 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-15 23:01:36,757 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,757 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,758 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:36,758 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:36,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:36,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:36,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:36,759 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:36,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,759 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:36,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,759 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:36,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,760 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:36,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:36,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,760 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:36,760 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,760 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 23:01:36,763 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-15 23:01:36,763 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:36,765 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 23:01:36,765 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-15 23:01:36,765 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:36,767 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 23:01:36,768 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:36,768 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. started... 2023-02-15 23:01:36,768 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:36,768 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. started... 2023-02-15 23:01:36,768 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e45ebaf46b12dc5f0978933ed3e5d2d0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:36,768 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:36,768 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. started... 2023-02-15 23:01:36,768 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e81ac83dd74dda68998ba3892f54397d 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 23:01:36,768 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 94714b23b200be2464cbfd2bde7728e7: 2023-02-15 23:01:36,768 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:36,768 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 23:01:36,768 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 23:01:36,768 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:36,768 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. started... 2023-02-15 23:01:36,768 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c5529c81671502769bca83930b3ef9c3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:36,769 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:36,770 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:36,770 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. started... 2023-02-15 23:01:36,770 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:36,770 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. started... 2023-02-15 23:01:36,770 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. started... 2023-02-15 23:01:36,770 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 23:01:36,770 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 23:01:36,770 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ef42f0baedb02ca105755e274e954d6a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:36,771 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 23:01:36,771 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 34fc5c64f675227c7d2471a10e261971 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:36,771 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ba3aee43e72569c4a8cb9c546efb6f3f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:36,798 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/.tmp/f1/b63b3dc93a6246fda14b6c4478515216 2023-02-15 23:01:36,798 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/.tmp/f1/e2f055f5d7a546bd9554fd011e5d0ff5 2023-02-15 23:01:36,805 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/.tmp/f1/768f6c2ed29a4bd2bd8a7462fb909a3e 2023-02-15 23:01:36,805 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/.tmp/f1/71540165f77245fe98277cf48a6a18a4 2023-02-15 23:01:36,848 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/.tmp/f2/bb290506d5594aada93701bdb3c40756 2023-02-15 23:01:36,848 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/.tmp/f2/a45bb06e4a3c4c86b3a3d1584b5a6214 2023-02-15 23:01:36,854 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/.tmp/f2/20f4b3a5a4a04d9d9de136c7042e9e4e 2023-02-15 23:01:36,855 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/.tmp/f1/b63b3dc93a6246fda14b6c4478515216 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1/b63b3dc93a6246fda14b6c4478515216 2023-02-15 23:01:36,856 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/.tmp/f1/768f6c2ed29a4bd2bd8a7462fb909a3e as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1/768f6c2ed29a4bd2bd8a7462fb909a3e 2023-02-15 23:01:36,859 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/.tmp/f1/e2f055f5d7a546bd9554fd011e5d0ff5 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1/e2f055f5d7a546bd9554fd011e5d0ff5 2023-02-15 23:01:36,861 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1/768f6c2ed29a4bd2bd8a7462fb909a3e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:36,862 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1/b63b3dc93a6246fda14b6c4478515216, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:36,862 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/.tmp/f2/bb290506d5594aada93701bdb3c40756 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2/bb290506d5594aada93701bdb3c40756 2023-02-15 23:01:36,863 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/.tmp/f2/a45bb06e4a3c4c86b3a3d1584b5a6214 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2/a45bb06e4a3c4c86b3a3d1584b5a6214 2023-02-15 23:01:36,865 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1/e2f055f5d7a546bd9554fd011e5d0ff5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:36,866 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/.tmp/f2/20f4b3a5a4a04d9d9de136c7042e9e4e as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2/20f4b3a5a4a04d9d9de136c7042e9e4e 2023-02-15 23:01:36,868 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2/bb290506d5594aada93701bdb3c40756, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:36,868 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2/a45bb06e4a3c4c86b3a3d1584b5a6214, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:36,869 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ef42f0baedb02ca105755e274e954d6a in 99ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:36,869 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ef42f0baedb02ca105755e274e954d6a: 2023-02-15 23:01:36,869 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:36,869 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c5529c81671502769bca83930b3ef9c3 in 101ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:36,869 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 23:01:36,869 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c5529c81671502769bca83930b3ef9c3: 2023-02-15 23:01:36,869 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:36,869 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:36,869 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. started... 2023-02-15 23:01:36,869 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 23:01:36,869 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:36,870 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9be0ccb017aa72d71b3f6f2b4d528bbf: 2023-02-15 23:01:36,870 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. started... 2023-02-15 23:01:36,870 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:36,870 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 23:01:36,870 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 498f2da6b4a7b12b99403e474e841cee 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 23:01:36,872 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2/20f4b3a5a4a04d9d9de136c7042e9e4e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:36,872 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e45ebaf46b12dc5f0978933ed3e5d2d0 in 104ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:36,872 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e45ebaf46b12dc5f0978933ed3e5d2d0: 2023-02-15 23:01:36,872 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:36,872 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:36,872 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 23:01:36,872 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. started... 2023-02-15 23:01:36,873 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ef17769adbcffd4b9e090a0403e7dd4a 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 23:01:36,881 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/.tmp/f1/fc70cfa1b00d4a35ba626a3271bf9460 2023-02-15 23:01:36,883 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/.tmp/f1/71d1f37ca38749a2b56c23ec493eb7a7 2023-02-15 23:01:36,893 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/.tmp/f2/e88f5774f7704502b2d8abb4c55a9847 2023-02-15 23:01:36,895 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/.tmp/f2/8021e907c43245d5813deb310b0bc1a4 2023-02-15 23:01:36,897 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/.tmp/f1/fc70cfa1b00d4a35ba626a3271bf9460 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1/fc70cfa1b00d4a35ba626a3271bf9460 2023-02-15 23:01:36,899 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/.tmp/f1/71d1f37ca38749a2b56c23ec493eb7a7 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1/71d1f37ca38749a2b56c23ec493eb7a7 2023-02-15 23:01:36,901 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1/fc70cfa1b00d4a35ba626a3271bf9460, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:36,902 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/.tmp/f2/e88f5774f7704502b2d8abb4c55a9847 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2/e88f5774f7704502b2d8abb4c55a9847 2023-02-15 23:01:36,904 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1/71d1f37ca38749a2b56c23ec493eb7a7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 23:01:36,905 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/.tmp/f2/8021e907c43245d5813deb310b0bc1a4 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2/8021e907c43245d5813deb310b0bc1a4 2023-02-15 23:01:36,907 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2/e88f5774f7704502b2d8abb4c55a9847, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:36,907 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 498f2da6b4a7b12b99403e474e841cee in 37ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:36,907 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 498f2da6b4a7b12b99403e474e841cee: 2023-02-15 23:01:36,907 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:36,908 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 23:01:36,909 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2/8021e907c43245d5813deb310b0bc1a4, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 23:01:36,910 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ef17769adbcffd4b9e090a0403e7dd4a in 37ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:36,910 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ef17769adbcffd4b9e090a0403e7dd4a: 2023-02-15 23:01:36,910 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:36,910 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 23:01:37,200 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/.tmp/f1/8ffaf57bdb984c1885b0c96c2f0a0bb4 2023-02-15 23:01:37,204 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/.tmp/f1/14a747f402c6487ba17164327f8e1d04 2023-02-15 23:01:37,220 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/.tmp/f2/91f127516fc34a1b9cb5e1b97f10d13c 2023-02-15 23:01:37,222 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/.tmp/f2/14162b4109ba445a9fb9dfd903dfb11c 2023-02-15 23:01:37,224 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/.tmp/f1/8ffaf57bdb984c1885b0c96c2f0a0bb4 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1/8ffaf57bdb984c1885b0c96c2f0a0bb4 2023-02-15 23:01:37,226 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/.tmp/f1/14a747f402c6487ba17164327f8e1d04 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1/14a747f402c6487ba17164327f8e1d04 2023-02-15 23:01:37,228 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1/8ffaf57bdb984c1885b0c96c2f0a0bb4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:37,229 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/.tmp/f2/91f127516fc34a1b9cb5e1b97f10d13c as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2/91f127516fc34a1b9cb5e1b97f10d13c 2023-02-15 23:01:37,231 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1/14a747f402c6487ba17164327f8e1d04, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 23:01:37,232 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/.tmp/f2/14162b4109ba445a9fb9dfd903dfb11c as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2/14162b4109ba445a9fb9dfd903dfb11c 2023-02-15 23:01:37,235 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2/91f127516fc34a1b9cb5e1b97f10d13c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:37,236 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 34fc5c64f675227c7d2471a10e261971 in 465ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:37,236 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 34fc5c64f675227c7d2471a10e261971: 2023-02-15 23:01:37,236 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:37,236 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 23:01:37,238 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2/14162b4109ba445a9fb9dfd903dfb11c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 23:01:37,238 INFO [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e81ac83dd74dda68998ba3892f54397d in 470ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:37,238 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e81ac83dd74dda68998ba3892f54397d: 2023-02-15 23:01:37,238 DEBUG [rs(jenkins-hbase4.apache.org,37411,1676502093966)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:37,239 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 23:01:37,239 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 23:01:37,239 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,239 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 23:01:37,239 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37411,1676502093966' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 23:01:37,241 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,241 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:37,241 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,241 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:37,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:37,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:37,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37411,1676502093966' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 23:01:37,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49cd81b0[Count = 1] remaining members to acquire global barrier 2023-02-15 23:01:37,253 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/.tmp/f2/ebfed9997ca74566b7145df1fc4b7a85 2023-02-15 23:01:37,258 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/.tmp/f1/71540165f77245fe98277cf48a6a18a4 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1/71540165f77245fe98277cf48a6a18a4 2023-02-15 23:01:37,263 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1/71540165f77245fe98277cf48a6a18a4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:37,263 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/.tmp/f2/ebfed9997ca74566b7145df1fc4b7a85 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2/ebfed9997ca74566b7145df1fc4b7a85 2023-02-15 23:01:37,268 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2/ebfed9997ca74566b7145df1fc4b7a85, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 23:01:37,268 INFO [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ba3aee43e72569c4a8cb9c546efb6f3f in 498ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:37,268 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ba3aee43e72569c4a8cb9c546efb6f3f: 2023-02-15 23:01:37,269 DEBUG [rs(jenkins-hbase4.apache.org,37799,1676502093940)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:37,269 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 23:01:37,269 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 23:01:37,269 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,269 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 23:01:37,269 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37799,1676502093940' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 23:01:37,271 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,271 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:37,271 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,272 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:37,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37799,1676502093940' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 23:01:37,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49cd81b0[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:37,273 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-15 23:01:37,273 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,275 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,275 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,275 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 23:01:37,275 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 23:01:37,275 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 23:01:37,275 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 23:01:37,275 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,37411,1676502093966' in zk 2023-02-15 23:01:37,275 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,275 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,37799,1676502093940' in zk 2023-02-15 23:01:37,276 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,276 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:37,277 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,277 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 23:01:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:37,277 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:37,277 DEBUG [member: 'jenkins-hbase4.apache.org,37411,1676502093966' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 23:01:37,278 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,278 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 23:01:37,278 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:37,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:37,278 DEBUG [member: 'jenkins-hbase4.apache.org,37799,1676502093940' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 23:01:37,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:37,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:37,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,37411,1676502093966': 2023-02-15 23:01:37,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37411,1676502093966' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 23:01:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,37799,1676502093940': 2023-02-15 23:01:37,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37799,1676502093940' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 23:01:37,283 INFO [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-15 23:01:37,283 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:37,283 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:37,283 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,283 INFO [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 23:01:37,286 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,286 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,286 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,286 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:37,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,286 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:37,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:37,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:37,286 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:37,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:37,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:37,288 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,289 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,290 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:37,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,292 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:37,292 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:37,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:37,292 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:37,292 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:37,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:37,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:37,292 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-15 23:01:37,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 23:01:37,292 DEBUG [(jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:37,292 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:37,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:37,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:37,293 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,293 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,293 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:37,293 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,293 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:37,293 DEBUG [Listener at localhost/36203] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:37,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:37,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:37,293 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,293 DEBUG [Listener at localhost/36203] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 23:01:37,293 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,393 DEBUG [Listener at localhost/36203] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 23:01:37,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 23:01:37,400 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676502095996 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:37,400 DEBUG [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,401 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(239): region to add: e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:37,401 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(239): region to add: e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:37,401 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(239): region to add: 94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:37,401 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(239): region to add: c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:37,401 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(239): region to add: 34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:37,401 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(239): region to add: 498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:37,401 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(239): region to add: ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:37,401 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(239): region to add: ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:37,401 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(239): region to add: ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:37,401 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(239): region to add: 9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:37,401 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(585): clone region=e45ebaf46b12dc5f0978933ed3e5d2d0 as e45ebaf46b12dc5f0978933ed3e5d2d0 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,402 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(585): clone region=e81ac83dd74dda68998ba3892f54397d as e81ac83dd74dda68998ba3892f54397d in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,402 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(585): clone region=94714b23b200be2464cbfd2bde7728e7 as 94714b23b200be2464cbfd2bde7728e7 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,402 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(585): clone region=c5529c81671502769bca83930b3ef9c3 as c5529c81671502769bca83930b3ef9c3 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,402 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(585): clone region=34fc5c64f675227c7d2471a10e261971 as 34fc5c64f675227c7d2471a10e261971 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,402 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(585): clone region=498f2da6b4a7b12b99403e474e841cee as 498f2da6b4a7b12b99403e474e841cee in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,402 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(585): clone region=ba3aee43e72569c4a8cb9c546efb6f3f as ba3aee43e72569c4a8cb9c546efb6f3f in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,402 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(585): clone region=ef42f0baedb02ca105755e274e954d6a as ef42f0baedb02ca105755e274e954d6a in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,402 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(585): clone region=ef17769adbcffd4b9e090a0403e7dd4a as ef17769adbcffd4b9e090a0403e7dd4a in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,402 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(585): clone region=9be0ccb017aa72d71b3f6f2b4d528bbf as 9be0ccb017aa72d71b3f6f2b4d528bbf in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,404 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => ba3aee43e72569c4a8cb9c546efb6f3f, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5 2023-02-15 23:01:37,404 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e45ebaf46b12dc5f0978933ed3e5d2d0, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5 2023-02-15 23:01:37,404 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 34fc5c64f675227c7d2471a10e261971, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5 2023-02-15 23:01:37,405 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 94714b23b200be2464cbfd2bde7728e7, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5 2023-02-15 23:01:37,405 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => e81ac83dd74dda68998ba3892f54397d, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5 2023-02-15 23:01:37,405 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 498f2da6b4a7b12b99403e474e841cee, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5 2023-02-15 23:01:37,405 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => ef42f0baedb02ca105755e274e954d6a, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5 2023-02-15 23:01:37,405 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => c5529c81671502769bca83930b3ef9c3, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5 2023-02-15 23:01:37,435 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:37,435 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 94714b23b200be2464cbfd2bde7728e7, disabling compactions & flushes 2023-02-15 23:01:37,436 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:37,436 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:37,436 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. after waiting 0 ms 2023-02-15 23:01:37,436 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:37,436 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:37,436 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 94714b23b200be2464cbfd2bde7728e7: 2023-02-15 23:01:37,436 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => ef17769adbcffd4b9e090a0403e7dd4a, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5 2023-02-15 23:01:37,450 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:37,451 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b6cdcd3da38f425490f508082443ed32 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,450 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:37,451 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a6be041e73d442569bd9e486f3944159 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,456 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:37,456 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9fcdc046e58f4704abae6366e56e8bff from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,456 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:37,457 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c8e43fdea77f46258026d286581bfa58 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,457 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7b53773e4b024a66be576d1413bc9098 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,464 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:37,464 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4f5d9a180b984409a6f588c47f644592 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,464 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:37,464 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e45ebaf46b12dc5f0978933ed3e5d2d0, disabling compactions & flushes 2023-02-15 23:01:37,464 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:37,464 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f638714f241542b286665476223e67e8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,464 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:37,465 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:37,464 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d16d5f87336844a0a6b149a83430d7af from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,465 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0dd2074330b249aaa233659df5517561 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,465 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. after waiting 0 ms 2023-02-15 23:01:37,465 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7fd4aa6baf10477bacd9ea35dd5d83e2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,465 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:37,465 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:37,465 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e45ebaf46b12dc5f0978933ed3e5d2d0: 2023-02-15 23:01:37,466 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9be0ccb017aa72d71b3f6f2b4d528bbf, NAME => 'testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5 2023-02-15 23:01:37,472 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5b0b4db82f30479d8f770fddbe8cfdef from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,472 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:37,472 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0236955c4d294001889da562884bac4a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,476 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d72da46bfe714aa88b7d6ef622feb6c1 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,476 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing e81ac83dd74dda68998ba3892f54397d, disabling compactions & flushes 2023-02-15 23:01:37,476 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:37,476 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:37,476 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. after waiting 0 ms 2023-02-15 23:01:37,476 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:37,476 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:37,476 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for e81ac83dd74dda68998ba3892f54397d: 2023-02-15 23:01:37,476 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b7d1b17519214fcaa756ee2a3a9aa812 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,477 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 252321992d4245be8205ed532afde168 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,477 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing c5529c81671502769bca83930b3ef9c3, disabling compactions & flushes 2023-02-15 23:01:37,477 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:37,477 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:37,477 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. after waiting 0 ms 2023-02-15 23:01:37,477 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:37,477 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:37,477 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for c5529c81671502769bca83930b3ef9c3: 2023-02-15 23:01:37,478 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 34fc5c64f675227c7d2471a10e261971, disabling compactions & flushes 2023-02-15 23:01:37,478 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:37,478 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:37,478 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. after waiting 0 ms 2023-02-15 23:01:37,478 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:37,478 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:37,478 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 34fc5c64f675227c7d2471a10e261971: 2023-02-15 23:01:37,480 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 498f2da6b4a7b12b99403e474e841cee, disabling compactions & flushes 2023-02-15 23:01:37,480 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:37,480 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:37,480 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. after waiting 0 ms 2023-02-15 23:01:37,480 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:37,480 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:37,480 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 498f2da6b4a7b12b99403e474e841cee: 2023-02-15 23:01:37,482 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing ba3aee43e72569c4a8cb9c546efb6f3f, disabling compactions & flushes 2023-02-15 23:01:37,482 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:37,482 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:37,482 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. after waiting 0 ms 2023-02-15 23:01:37,482 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:37,482 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:37,482 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0e4b2c171a6b4b4e9325a9aff067f8eb from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:37,482 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for ba3aee43e72569c4a8cb9c546efb6f3f: 2023-02-15 23:01:37,483 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing ef42f0baedb02ca105755e274e954d6a, disabling compactions & flushes 2023-02-15 23:01:37,483 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:37,483 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:37,483 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. after waiting 0 ms 2023-02-15 23:01:37,483 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:37,483 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:37,483 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for ef42f0baedb02ca105755e274e954d6a: 2023-02-15 23:01:37,484 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:37,484 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 9be0ccb017aa72d71b3f6f2b4d528bbf, disabling compactions & flushes 2023-02-15 23:01:37,484 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:37,484 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:37,485 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. after waiting 0 ms 2023-02-15 23:01:37,485 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:37,485 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:37,485 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 9be0ccb017aa72d71b3f6f2b4d528bbf: 2023-02-15 23:01:37,485 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing ef17769adbcffd4b9e090a0403e7dd4a, disabling compactions & flushes 2023-02-15 23:01:37,485 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:37,485 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:37,485 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. after waiting 0 ms 2023-02-15 23:01:37,485 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:37,485 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:37,485 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for ef17769adbcffd4b9e090a0403e7dd4a: 2023-02-15 23:01:37,485 INFO [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676502095996 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:37,485 DEBUG [Listener at localhost/36203] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5 2023-02-15 23:01:37,485 DEBUG [Listener at localhost/36203] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5 2023-02-15 23:01:37,486 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-data/ 2023-02-15 23:01:37,486 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |----default/ 2023-02-15 23:01:37,487 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-15 23:01:37,487 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |----------34fc5c64f675227c7d2471a10e261971/ 2023-02-15 23:01:37,488 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:37,488 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:37,488 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=34fc5c64f675227c7d2471a10e261971-c8e43fdea77f46258026d286581bfa58 2023-02-15 23:01:37,488 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:37,489 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=34fc5c64f675227c7d2471a10e261971-5b0b4db82f30479d8f770fddbe8cfdef 2023-02-15 23:01:37,489 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |----------498f2da6b4a7b12b99403e474e841cee/ 2023-02-15 23:01:37,489 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:37,489 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:37,489 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=498f2da6b4a7b12b99403e474e841cee-0dd2074330b249aaa233659df5517561 2023-02-15 23:01:37,489 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:37,489 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=498f2da6b4a7b12b99403e474e841cee-252321992d4245be8205ed532afde168 2023-02-15 23:01:37,489 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |----------94714b23b200be2464cbfd2bde7728e7/ 2023-02-15 23:01:37,490 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:37,490 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |----------9be0ccb017aa72d71b3f6f2b4d528bbf/ 2023-02-15 23:01:37,490 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:37,490 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |----------ba3aee43e72569c4a8cb9c546efb6f3f/ 2023-02-15 23:01:37,490 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:37,490 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:37,491 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ba3aee43e72569c4a8cb9c546efb6f3f-4f5d9a180b984409a6f588c47f644592 2023-02-15 23:01:37,491 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:37,491 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ba3aee43e72569c4a8cb9c546efb6f3f-d72da46bfe714aa88b7d6ef622feb6c1 2023-02-15 23:01:37,491 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |----------c5529c81671502769bca83930b3ef9c3/ 2023-02-15 23:01:37,491 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:37,491 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:37,491 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c5529c81671502769bca83930b3ef9c3-9fcdc046e58f4704abae6366e56e8bff 2023-02-15 23:01:37,491 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:37,492 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c5529c81671502769bca83930b3ef9c3-7fd4aa6baf10477bacd9ea35dd5d83e2 2023-02-15 23:01:37,492 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |----------e45ebaf46b12dc5f0978933ed3e5d2d0/ 2023-02-15 23:01:37,492 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:37,492 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:37,492 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e45ebaf46b12dc5f0978933ed3e5d2d0-a6be041e73d442569bd9e486f3944159 2023-02-15 23:01:37,492 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:37,492 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e45ebaf46b12dc5f0978933ed3e5d2d0-7b53773e4b024a66be576d1413bc9098 2023-02-15 23:01:37,492 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |----------e81ac83dd74dda68998ba3892f54397d/ 2023-02-15 23:01:37,493 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:37,493 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:37,493 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e81ac83dd74dda68998ba3892f54397d-b6cdcd3da38f425490f508082443ed32 2023-02-15 23:01:37,493 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:37,493 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e81ac83dd74dda68998ba3892f54397d-d16d5f87336844a0a6b149a83430d7af 2023-02-15 23:01:37,493 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |----------ef17769adbcffd4b9e090a0403e7dd4a/ 2023-02-15 23:01:37,494 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:37,494 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:37,494 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ef17769adbcffd4b9e090a0403e7dd4a-0236955c4d294001889da562884bac4a 2023-02-15 23:01:37,494 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:37,494 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ef17769adbcffd4b9e090a0403e7dd4a-0e4b2c171a6b4b4e9325a9aff067f8eb 2023-02-15 23:01:37,494 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |----------ef42f0baedb02ca105755e274e954d6a/ 2023-02-15 23:01:37,494 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:37,494 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:37,495 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ef42f0baedb02ca105755e274e954d6a-f638714f241542b286665476223e67e8 2023-02-15 23:01:37,495 DEBUG [Listener at localhost/36203] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:37,495 DEBUG [Listener at localhost/36203] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ef42f0baedb02ca105755e274e954d6a-b7d1b17519214fcaa756ee2a3a9aa812 2023-02-15 23:01:37,498 INFO [Listener at localhost/36203] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 23:01:38,022 DEBUG [Listener at localhost/36203] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:38,022 INFO [Listener at localhost/36203] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:38,024 DEBUG [Listener at localhost/36203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:38,026 INFO [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:38,027 DEBUG [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1 2023-02-15 23:01:38,027 INFO [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34fc5c64f675227c7d2471a10e261971 columnFamilyName f1 2023-02-15 23:01:38,031 DEBUG [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1/testWithMockedMapReduceMultiRegion=34fc5c64f675227c7d2471a10e261971-c8e43fdea77f46258026d286581bfa58 2023-02-15 23:01:38,031 INFO [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] regionserver.HStore(310): Store=34fc5c64f675227c7d2471a10e261971/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,032 INFO [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:38,032 DEBUG [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2 2023-02-15 23:01:38,033 INFO [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34fc5c64f675227c7d2471a10e261971 columnFamilyName f2 2023-02-15 23:01:38,037 DEBUG [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2/testWithMockedMapReduceMultiRegion=34fc5c64f675227c7d2471a10e261971-5b0b4db82f30479d8f770fddbe8cfdef 2023-02-15 23:01:38,037 INFO [StoreOpener-34fc5c64f675227c7d2471a10e261971-1] regionserver.HStore(310): Store=34fc5c64f675227c7d2471a10e261971/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,037 DEBUG [Listener at localhost/36203] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:38,037 INFO [Listener at localhost/36203] regionserver.HRegion(1071): Opened 34fc5c64f675227c7d2471a10e261971; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68068804, jitterRate=0.01430422067642212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:38,037 DEBUG [Listener at localhost/36203] regionserver.HRegion(964): Region open journal for 34fc5c64f675227c7d2471a10e261971: 2023-02-15 23:01:38,049 DEBUG [Listener at localhost/36203] regionserver.HRegion(1603): Closing 34fc5c64f675227c7d2471a10e261971, disabling compactions & flushes 2023-02-15 23:01:38,051 INFO [Listener at localhost/36203] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:38,051 DEBUG [Listener at localhost/36203] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:38,051 DEBUG [Listener at localhost/36203] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. after waiting 0 ms 2023-02-15 23:01:38,051 DEBUG [Listener at localhost/36203] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:38,052 INFO [Listener at localhost/36203] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:38,052 DEBUG [Listener at localhost/36203] regionserver.HRegion(1557): Region close journal for 34fc5c64f675227c7d2471a10e261971: 2023-02-15 23:01:38,053 DEBUG [Listener at localhost/36203] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:38,053 INFO [Listener at localhost/36203] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:38,054 DEBUG [Listener at localhost/36203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:38,056 INFO [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:38,057 DEBUG [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf/f1 2023-02-15 23:01:38,058 INFO [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9be0ccb017aa72d71b3f6f2b4d528bbf columnFamilyName f1 2023-02-15 23:01:38,058 INFO [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] regionserver.HStore(310): Store=9be0ccb017aa72d71b3f6f2b4d528bbf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,058 INFO [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:38,059 DEBUG [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf/f2 2023-02-15 23:01:38,060 INFO [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9be0ccb017aa72d71b3f6f2b4d528bbf columnFamilyName f2 2023-02-15 23:01:38,060 INFO [StoreOpener-9be0ccb017aa72d71b3f6f2b4d528bbf-1] regionserver.HStore(310): Store=9be0ccb017aa72d71b3f6f2b4d528bbf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,060 DEBUG [Listener at localhost/36203] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:38,061 INFO [Listener at localhost/36203] regionserver.HRegion(1071): Opened 9be0ccb017aa72d71b3f6f2b4d528bbf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69741680, jitterRate=0.03923201560974121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:38,061 DEBUG [Listener at localhost/36203] regionserver.HRegion(964): Region open journal for 9be0ccb017aa72d71b3f6f2b4d528bbf: 2023-02-15 23:01:38,061 DEBUG [Listener at localhost/36203] regionserver.HRegion(1603): Closing 9be0ccb017aa72d71b3f6f2b4d528bbf, disabling compactions & flushes 2023-02-15 23:01:38,061 INFO [Listener at localhost/36203] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:38,061 DEBUG [Listener at localhost/36203] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:38,061 DEBUG [Listener at localhost/36203] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. after waiting 0 ms 2023-02-15 23:01:38,061 DEBUG [Listener at localhost/36203] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:38,061 INFO [Listener at localhost/36203] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:38,061 DEBUG [Listener at localhost/36203] regionserver.HRegion(1557): Region close journal for 9be0ccb017aa72d71b3f6f2b4d528bbf: 2023-02-15 23:01:38,062 DEBUG [Listener at localhost/36203] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:38,062 INFO [Listener at localhost/36203] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:38,063 DEBUG [Listener at localhost/36203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:38,069 INFO [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:38,070 DEBUG [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7/f1 2023-02-15 23:01:38,070 INFO [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94714b23b200be2464cbfd2bde7728e7 columnFamilyName f1 2023-02-15 23:01:38,072 INFO [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] regionserver.HStore(310): Store=94714b23b200be2464cbfd2bde7728e7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,072 INFO [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:38,073 DEBUG [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7/f2 2023-02-15 23:01:38,073 INFO [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94714b23b200be2464cbfd2bde7728e7 columnFamilyName f2 2023-02-15 23:01:38,073 INFO [StoreOpener-94714b23b200be2464cbfd2bde7728e7-1] regionserver.HStore(310): Store=94714b23b200be2464cbfd2bde7728e7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,074 DEBUG [Listener at localhost/36203] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:38,074 INFO [Listener at localhost/36203] regionserver.HRegion(1071): Opened 94714b23b200be2464cbfd2bde7728e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64372637, jitterRate=-0.04077295958995819}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:38,074 DEBUG [Listener at localhost/36203] regionserver.HRegion(964): Region open journal for 94714b23b200be2464cbfd2bde7728e7: 2023-02-15 23:01:38,074 DEBUG [Listener at localhost/36203] regionserver.HRegion(1603): Closing 94714b23b200be2464cbfd2bde7728e7, disabling compactions & flushes 2023-02-15 23:01:38,074 INFO [Listener at localhost/36203] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:38,074 DEBUG [Listener at localhost/36203] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:38,074 DEBUG [Listener at localhost/36203] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. after waiting 0 ms 2023-02-15 23:01:38,074 DEBUG [Listener at localhost/36203] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:38,075 INFO [Listener at localhost/36203] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:38,075 DEBUG [Listener at localhost/36203] regionserver.HRegion(1557): Region close journal for 94714b23b200be2464cbfd2bde7728e7: 2023-02-15 23:01:38,075 DEBUG [Listener at localhost/36203] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:38,075 INFO [Listener at localhost/36203] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:38,077 DEBUG [Listener at localhost/36203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:38,078 INFO [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:38,079 DEBUG [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1 2023-02-15 23:01:38,079 INFO [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5529c81671502769bca83930b3ef9c3 columnFamilyName f1 2023-02-15 23:01:38,083 DEBUG [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1/testWithMockedMapReduceMultiRegion=c5529c81671502769bca83930b3ef9c3-9fcdc046e58f4704abae6366e56e8bff 2023-02-15 23:01:38,084 INFO [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] regionserver.HStore(310): Store=c5529c81671502769bca83930b3ef9c3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,084 INFO [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:38,084 DEBUG [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2 2023-02-15 23:01:38,085 INFO [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5529c81671502769bca83930b3ef9c3 columnFamilyName f2 2023-02-15 23:01:38,088 DEBUG [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2/testWithMockedMapReduceMultiRegion=c5529c81671502769bca83930b3ef9c3-7fd4aa6baf10477bacd9ea35dd5d83e2 2023-02-15 23:01:38,089 INFO [StoreOpener-c5529c81671502769bca83930b3ef9c3-1] regionserver.HStore(310): Store=c5529c81671502769bca83930b3ef9c3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,089 DEBUG [Listener at localhost/36203] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:38,089 INFO [Listener at localhost/36203] regionserver.HRegion(1071): Opened c5529c81671502769bca83930b3ef9c3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69884999, jitterRate=0.04136763513088226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:38,089 DEBUG [Listener at localhost/36203] regionserver.HRegion(964): Region open journal for c5529c81671502769bca83930b3ef9c3: 2023-02-15 23:01:38,097 DEBUG [Listener at localhost/36203] regionserver.HRegion(1603): Closing c5529c81671502769bca83930b3ef9c3, disabling compactions & flushes 2023-02-15 23:01:38,098 INFO [Listener at localhost/36203] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:38,098 DEBUG [Listener at localhost/36203] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:38,098 DEBUG [Listener at localhost/36203] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. after waiting 0 ms 2023-02-15 23:01:38,098 DEBUG [Listener at localhost/36203] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:38,098 INFO [Listener at localhost/36203] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:38,098 DEBUG [Listener at localhost/36203] regionserver.HRegion(1557): Region close journal for c5529c81671502769bca83930b3ef9c3: 2023-02-15 23:01:38,099 DEBUG [Listener at localhost/36203] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:38,099 INFO [Listener at localhost/36203] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:38,104 DEBUG [Listener at localhost/36203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:38,106 INFO [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:38,107 DEBUG [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1 2023-02-15 23:01:38,107 INFO [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 498f2da6b4a7b12b99403e474e841cee columnFamilyName f1 2023-02-15 23:01:38,112 DEBUG [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1/testWithMockedMapReduceMultiRegion=498f2da6b4a7b12b99403e474e841cee-0dd2074330b249aaa233659df5517561 2023-02-15 23:01:38,112 INFO [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] regionserver.HStore(310): Store=498f2da6b4a7b12b99403e474e841cee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,112 INFO [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:38,113 DEBUG [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2 2023-02-15 23:01:38,113 INFO [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 498f2da6b4a7b12b99403e474e841cee columnFamilyName f2 2023-02-15 23:01:38,119 DEBUG [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2/testWithMockedMapReduceMultiRegion=498f2da6b4a7b12b99403e474e841cee-252321992d4245be8205ed532afde168 2023-02-15 23:01:38,119 INFO [StoreOpener-498f2da6b4a7b12b99403e474e841cee-1] regionserver.HStore(310): Store=498f2da6b4a7b12b99403e474e841cee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,120 DEBUG [Listener at localhost/36203] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:38,120 INFO [Listener at localhost/36203] regionserver.HRegion(1071): Opened 498f2da6b4a7b12b99403e474e841cee; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63954719, jitterRate=-0.047000423073768616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:38,120 DEBUG [Listener at localhost/36203] regionserver.HRegion(964): Region open journal for 498f2da6b4a7b12b99403e474e841cee: 2023-02-15 23:01:38,128 DEBUG [Listener at localhost/36203] regionserver.HRegion(1603): Closing 498f2da6b4a7b12b99403e474e841cee, disabling compactions & flushes 2023-02-15 23:01:38,129 INFO [Listener at localhost/36203] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:38,129 DEBUG [Listener at localhost/36203] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:38,129 DEBUG [Listener at localhost/36203] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. after waiting 0 ms 2023-02-15 23:01:38,129 DEBUG [Listener at localhost/36203] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:38,130 INFO [Listener at localhost/36203] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:38,130 DEBUG [Listener at localhost/36203] regionserver.HRegion(1557): Region close journal for 498f2da6b4a7b12b99403e474e841cee: 2023-02-15 23:01:38,130 DEBUG [Listener at localhost/36203] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:38,131 INFO [Listener at localhost/36203] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:38,132 DEBUG [Listener at localhost/36203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:38,134 INFO [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:38,135 DEBUG [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1 2023-02-15 23:01:38,135 INFO [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba3aee43e72569c4a8cb9c546efb6f3f columnFamilyName f1 2023-02-15 23:01:38,139 DEBUG [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1/testWithMockedMapReduceMultiRegion=ba3aee43e72569c4a8cb9c546efb6f3f-4f5d9a180b984409a6f588c47f644592 2023-02-15 23:01:38,139 INFO [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] regionserver.HStore(310): Store=ba3aee43e72569c4a8cb9c546efb6f3f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,140 INFO [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:38,140 DEBUG [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2 2023-02-15 23:01:38,140 INFO [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba3aee43e72569c4a8cb9c546efb6f3f columnFamilyName f2 2023-02-15 23:01:38,144 DEBUG [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2/testWithMockedMapReduceMultiRegion=ba3aee43e72569c4a8cb9c546efb6f3f-d72da46bfe714aa88b7d6ef622feb6c1 2023-02-15 23:01:38,144 INFO [StoreOpener-ba3aee43e72569c4a8cb9c546efb6f3f-1] regionserver.HStore(310): Store=ba3aee43e72569c4a8cb9c546efb6f3f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,144 DEBUG [Listener at localhost/36203] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:38,144 INFO [Listener at localhost/36203] regionserver.HRegion(1071): Opened ba3aee43e72569c4a8cb9c546efb6f3f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64219618, jitterRate=-0.043053120374679565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:38,144 DEBUG [Listener at localhost/36203] regionserver.HRegion(964): Region open journal for ba3aee43e72569c4a8cb9c546efb6f3f: 2023-02-15 23:01:38,153 DEBUG [Listener at localhost/36203] regionserver.HRegion(1603): Closing ba3aee43e72569c4a8cb9c546efb6f3f, disabling compactions & flushes 2023-02-15 23:01:38,153 INFO [Listener at localhost/36203] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:38,153 DEBUG [Listener at localhost/36203] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:38,153 DEBUG [Listener at localhost/36203] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. after waiting 0 ms 2023-02-15 23:01:38,153 DEBUG [Listener at localhost/36203] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:38,154 INFO [Listener at localhost/36203] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:38,154 DEBUG [Listener at localhost/36203] regionserver.HRegion(1557): Region close journal for ba3aee43e72569c4a8cb9c546efb6f3f: 2023-02-15 23:01:38,155 DEBUG [Listener at localhost/36203] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:38,155 INFO [Listener at localhost/36203] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:38,156 DEBUG [Listener at localhost/36203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:38,158 INFO [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:38,159 DEBUG [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1 2023-02-15 23:01:38,159 INFO [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e45ebaf46b12dc5f0978933ed3e5d2d0 columnFamilyName f1 2023-02-15 23:01:38,164 DEBUG [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1/testWithMockedMapReduceMultiRegion=e45ebaf46b12dc5f0978933ed3e5d2d0-a6be041e73d442569bd9e486f3944159 2023-02-15 23:01:38,164 INFO [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] regionserver.HStore(310): Store=e45ebaf46b12dc5f0978933ed3e5d2d0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,164 INFO [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:38,165 DEBUG [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2 2023-02-15 23:01:38,165 INFO [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e45ebaf46b12dc5f0978933ed3e5d2d0 columnFamilyName f2 2023-02-15 23:01:38,169 DEBUG [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2/testWithMockedMapReduceMultiRegion=e45ebaf46b12dc5f0978933ed3e5d2d0-7b53773e4b024a66be576d1413bc9098 2023-02-15 23:01:38,170 INFO [StoreOpener-e45ebaf46b12dc5f0978933ed3e5d2d0-1] regionserver.HStore(310): Store=e45ebaf46b12dc5f0978933ed3e5d2d0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,170 DEBUG [Listener at localhost/36203] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:38,170 INFO [Listener at localhost/36203] regionserver.HRegion(1071): Opened e45ebaf46b12dc5f0978933ed3e5d2d0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62628911, jitterRate=-0.06675650179386139}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:38,170 DEBUG [Listener at localhost/36203] regionserver.HRegion(964): Region open journal for e45ebaf46b12dc5f0978933ed3e5d2d0: 2023-02-15 23:01:38,180 DEBUG [Listener at localhost/36203] regionserver.HRegion(1603): Closing e45ebaf46b12dc5f0978933ed3e5d2d0, disabling compactions & flushes 2023-02-15 23:01:38,180 INFO [Listener at localhost/36203] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:38,180 DEBUG [Listener at localhost/36203] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:38,180 DEBUG [Listener at localhost/36203] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. after waiting 0 ms 2023-02-15 23:01:38,180 DEBUG [Listener at localhost/36203] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:38,181 INFO [Listener at localhost/36203] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:38,181 DEBUG [Listener at localhost/36203] regionserver.HRegion(1557): Region close journal for e45ebaf46b12dc5f0978933ed3e5d2d0: 2023-02-15 23:01:38,182 DEBUG [Listener at localhost/36203] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:38,182 INFO [Listener at localhost/36203] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:38,186 DEBUG [Listener at localhost/36203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:38,189 INFO [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:38,189 DEBUG [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1 2023-02-15 23:01:38,190 INFO [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef42f0baedb02ca105755e274e954d6a columnFamilyName f1 2023-02-15 23:01:38,194 DEBUG [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1/testWithMockedMapReduceMultiRegion=ef42f0baedb02ca105755e274e954d6a-f638714f241542b286665476223e67e8 2023-02-15 23:01:38,194 INFO [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] regionserver.HStore(310): Store=ef42f0baedb02ca105755e274e954d6a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,194 INFO [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:38,195 DEBUG [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2 2023-02-15 23:01:38,195 INFO [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef42f0baedb02ca105755e274e954d6a columnFamilyName f2 2023-02-15 23:01:38,198 DEBUG [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2/testWithMockedMapReduceMultiRegion=ef42f0baedb02ca105755e274e954d6a-b7d1b17519214fcaa756ee2a3a9aa812 2023-02-15 23:01:38,198 INFO [StoreOpener-ef42f0baedb02ca105755e274e954d6a-1] regionserver.HStore(310): Store=ef42f0baedb02ca105755e274e954d6a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,198 DEBUG [Listener at localhost/36203] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:38,198 INFO [Listener at localhost/36203] regionserver.HRegion(1071): Opened ef42f0baedb02ca105755e274e954d6a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69563732, jitterRate=0.03658038377761841}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:38,199 DEBUG [Listener at localhost/36203] regionserver.HRegion(964): Region open journal for ef42f0baedb02ca105755e274e954d6a: 2023-02-15 23:01:38,206 DEBUG [Listener at localhost/36203] regionserver.HRegion(1603): Closing ef42f0baedb02ca105755e274e954d6a, disabling compactions & flushes 2023-02-15 23:01:38,206 INFO [Listener at localhost/36203] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:38,206 DEBUG [Listener at localhost/36203] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:38,206 DEBUG [Listener at localhost/36203] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. after waiting 0 ms 2023-02-15 23:01:38,207 DEBUG [Listener at localhost/36203] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:38,207 INFO [Listener at localhost/36203] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:38,207 DEBUG [Listener at localhost/36203] regionserver.HRegion(1557): Region close journal for ef42f0baedb02ca105755e274e954d6a: 2023-02-15 23:01:38,208 DEBUG [Listener at localhost/36203] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:38,208 INFO [Listener at localhost/36203] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:38,209 DEBUG [Listener at localhost/36203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:38,211 INFO [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:38,211 DEBUG [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1 2023-02-15 23:01:38,211 INFO [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e81ac83dd74dda68998ba3892f54397d columnFamilyName f1 2023-02-15 23:01:38,215 DEBUG [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1/testWithMockedMapReduceMultiRegion=e81ac83dd74dda68998ba3892f54397d-b6cdcd3da38f425490f508082443ed32 2023-02-15 23:01:38,215 INFO [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] regionserver.HStore(310): Store=e81ac83dd74dda68998ba3892f54397d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,215 INFO [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:38,216 DEBUG [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2 2023-02-15 23:01:38,216 INFO [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e81ac83dd74dda68998ba3892f54397d columnFamilyName f2 2023-02-15 23:01:38,219 DEBUG [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2/testWithMockedMapReduceMultiRegion=e81ac83dd74dda68998ba3892f54397d-d16d5f87336844a0a6b149a83430d7af 2023-02-15 23:01:38,219 INFO [StoreOpener-e81ac83dd74dda68998ba3892f54397d-1] regionserver.HStore(310): Store=e81ac83dd74dda68998ba3892f54397d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,220 DEBUG [Listener at localhost/36203] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:38,220 INFO [Listener at localhost/36203] regionserver.HRegion(1071): Opened e81ac83dd74dda68998ba3892f54397d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59786298, jitterRate=-0.10911473631858826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:38,220 DEBUG [Listener at localhost/36203] regionserver.HRegion(964): Region open journal for e81ac83dd74dda68998ba3892f54397d: 2023-02-15 23:01:38,229 DEBUG [Listener at localhost/36203] regionserver.HRegion(1603): Closing e81ac83dd74dda68998ba3892f54397d, disabling compactions & flushes 2023-02-15 23:01:38,229 INFO [Listener at localhost/36203] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:38,229 DEBUG [Listener at localhost/36203] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:38,229 DEBUG [Listener at localhost/36203] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. after waiting 0 ms 2023-02-15 23:01:38,229 DEBUG [Listener at localhost/36203] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:38,230 INFO [Listener at localhost/36203] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:38,230 DEBUG [Listener at localhost/36203] regionserver.HRegion(1557): Region close journal for e81ac83dd74dda68998ba3892f54397d: 2023-02-15 23:01:38,231 DEBUG [Listener at localhost/36203] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:38,231 INFO [Listener at localhost/36203] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:38,232 DEBUG [Listener at localhost/36203] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:38,233 INFO [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:38,234 DEBUG [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1 2023-02-15 23:01:38,234 INFO [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef17769adbcffd4b9e090a0403e7dd4a columnFamilyName f1 2023-02-15 23:01:38,237 DEBUG [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1/testWithMockedMapReduceMultiRegion=ef17769adbcffd4b9e090a0403e7dd4a-0236955c4d294001889da562884bac4a 2023-02-15 23:01:38,237 INFO [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] regionserver.HStore(310): Store=ef17769adbcffd4b9e090a0403e7dd4a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,238 INFO [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:38,238 DEBUG [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2 2023-02-15 23:01:38,238 INFO [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef17769adbcffd4b9e090a0403e7dd4a columnFamilyName f2 2023-02-15 23:01:38,241 DEBUG [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] regionserver.HStore(539): loaded hdfs://localhost:33779/user/jenkins/test-data/92e2b846-762f-1bca-a8a2-6f979a20229a/testWithMockedMapReduceMultiRegion/362c9a35-8510-4ae6-bfb7-3087c632e6f5/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2/testWithMockedMapReduceMultiRegion=ef17769adbcffd4b9e090a0403e7dd4a-0e4b2c171a6b4b4e9325a9aff067f8eb 2023-02-15 23:01:38,242 INFO [StoreOpener-ef17769adbcffd4b9e090a0403e7dd4a-1] regionserver.HStore(310): Store=ef17769adbcffd4b9e090a0403e7dd4a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:38,242 DEBUG [Listener at localhost/36203] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:38,242 INFO [Listener at localhost/36203] regionserver.HRegion(1071): Opened ef17769adbcffd4b9e090a0403e7dd4a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69655073, jitterRate=0.03794147074222565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:38,242 DEBUG [Listener at localhost/36203] regionserver.HRegion(964): Region open journal for ef17769adbcffd4b9e090a0403e7dd4a: 2023-02-15 23:01:38,251 DEBUG [Listener at localhost/36203] regionserver.HRegion(1603): Closing ef17769adbcffd4b9e090a0403e7dd4a, disabling compactions & flushes 2023-02-15 23:01:38,251 INFO [Listener at localhost/36203] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:38,251 DEBUG [Listener at localhost/36203] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:38,252 DEBUG [Listener at localhost/36203] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. after waiting 0 ms 2023-02-15 23:01:38,252 DEBUG [Listener at localhost/36203] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:38,252 INFO [Listener at localhost/36203] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:38,252 DEBUG [Listener at localhost/36203] regionserver.HRegion(1557): Region close journal for ef17769adbcffd4b9e090a0403e7dd4a: 2023-02-15 23:01:38,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-15 23:01:38,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-15 23:01:38,260 INFO [Listener at localhost/36203] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-15 23:01:38,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-15 23:01:38,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:38,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 23:01:38,263 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502098263"}]},"ts":"1676502098263"} 2023-02-15 23:01:38,265 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-15 23:01:38,266 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-15 23:01:38,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9be0ccb017aa72d71b3f6f2b4d528bbf, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef17769adbcffd4b9e090a0403e7dd4a, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e45ebaf46b12dc5f0978933ed3e5d2d0, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c5529c81671502769bca83930b3ef9c3, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef42f0baedb02ca105755e274e954d6a, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34fc5c64f675227c7d2471a10e261971, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=498f2da6b4a7b12b99403e474e841cee, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba3aee43e72569c4a8cb9c546efb6f3f, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e81ac83dd74dda68998ba3892f54397d, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=94714b23b200be2464cbfd2bde7728e7, UNASSIGN}] 2023-02-15 23:01:38,268 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef17769adbcffd4b9e090a0403e7dd4a, UNASSIGN 2023-02-15 23:01:38,268 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c5529c81671502769bca83930b3ef9c3, UNASSIGN 2023-02-15 23:01:38,268 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9be0ccb017aa72d71b3f6f2b4d528bbf, UNASSIGN 2023-02-15 23:01:38,269 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e45ebaf46b12dc5f0978933ed3e5d2d0, UNASSIGN 2023-02-15 23:01:38,269 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=94714b23b200be2464cbfd2bde7728e7, UNASSIGN 2023-02-15 23:01:38,269 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=ef17769adbcffd4b9e090a0403e7dd4a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:38,269 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c5529c81671502769bca83930b3ef9c3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:38,269 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e45ebaf46b12dc5f0978933ed3e5d2d0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:38,269 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502098269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502098269"}]},"ts":"1676502098269"} 2023-02-15 23:01:38,269 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502098269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502098269"}]},"ts":"1676502098269"} 2023-02-15 23:01:38,269 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=94714b23b200be2464cbfd2bde7728e7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:38,269 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=9be0ccb017aa72d71b3f6f2b4d528bbf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:38,269 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676502098269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502098269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502098269"}]},"ts":"1676502098269"} 2023-02-15 23:01:38,269 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502098269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502098269"}]},"ts":"1676502098269"} 2023-02-15 23:01:38,270 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676502098269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502098269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502098269"}]},"ts":"1676502098269"} 2023-02-15 23:01:38,270 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=37, state=RUNNABLE; CloseRegionProcedure c5529c81671502769bca83930b3ef9c3, server=jenkins-hbase4.apache.org,37411,1676502093966}] 2023-02-15 23:01:38,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=35, state=RUNNABLE; CloseRegionProcedure ef17769adbcffd4b9e090a0403e7dd4a, server=jenkins-hbase4.apache.org,37411,1676502093966}] 2023-02-15 23:01:38,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; CloseRegionProcedure 94714b23b200be2464cbfd2bde7728e7, server=jenkins-hbase4.apache.org,37799,1676502093940}] 2023-02-15 23:01:38,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=34, state=RUNNABLE; CloseRegionProcedure 9be0ccb017aa72d71b3f6f2b4d528bbf, server=jenkins-hbase4.apache.org,37799,1676502093940}] 2023-02-15 23:01:38,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=36, state=RUNNABLE; CloseRegionProcedure e45ebaf46b12dc5f0978933ed3e5d2d0, server=jenkins-hbase4.apache.org,37411,1676502093966}] 2023-02-15 23:01:38,276 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e81ac83dd74dda68998ba3892f54397d, UNASSIGN 2023-02-15 23:01:38,276 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba3aee43e72569c4a8cb9c546efb6f3f, UNASSIGN 2023-02-15 23:01:38,276 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=498f2da6b4a7b12b99403e474e841cee, UNASSIGN 2023-02-15 23:01:38,276 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34fc5c64f675227c7d2471a10e261971, UNASSIGN 2023-02-15 23:01:38,277 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef42f0baedb02ca105755e274e954d6a, UNASSIGN 2023-02-15 23:01:38,277 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=e81ac83dd74dda68998ba3892f54397d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:38,277 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098277"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502098277"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502098277"}]},"ts":"1676502098277"} 2023-02-15 23:01:38,277 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=ba3aee43e72569c4a8cb9c546efb6f3f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:38,277 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=498f2da6b4a7b12b99403e474e841cee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:38,277 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098277"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502098277"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502098277"}]},"ts":"1676502098277"} 2023-02-15 23:01:38,277 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098277"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502098277"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502098277"}]},"ts":"1676502098277"} 2023-02-15 23:01:38,277 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=34fc5c64f675227c7d2471a10e261971, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:38,277 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098277"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502098277"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502098277"}]},"ts":"1676502098277"} 2023-02-15 23:01:38,278 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ef42f0baedb02ca105755e274e954d6a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:38,278 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502098278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502098278"}]},"ts":"1676502098278"} 2023-02-15 23:01:38,278 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure e81ac83dd74dda68998ba3892f54397d, server=jenkins-hbase4.apache.org,37411,1676502093966}] 2023-02-15 23:01:38,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure ba3aee43e72569c4a8cb9c546efb6f3f, server=jenkins-hbase4.apache.org,37799,1676502093940}] 2023-02-15 23:01:38,279 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 498f2da6b4a7b12b99403e474e841cee, server=jenkins-hbase4.apache.org,37411,1676502093966}] 2023-02-15 23:01:38,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 34fc5c64f675227c7d2471a10e261971, server=jenkins-hbase4.apache.org,37799,1676502093940}] 2023-02-15 23:01:38,284 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure ef42f0baedb02ca105755e274e954d6a, server=jenkins-hbase4.apache.org,37799,1676502093940}] 2023-02-15 23:01:38,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 23:01:38,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:38,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:38,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ef42f0baedb02ca105755e274e954d6a, disabling compactions & flushes 2023-02-15 23:01:38,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ef17769adbcffd4b9e090a0403e7dd4a, disabling compactions & flushes 2023-02-15 23:01:38,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:38,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:38,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:38,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. after waiting 0 ms 2023-02-15 23:01:38,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:38,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:38,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. after waiting 0 ms 2023-02-15 23:01:38,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:38,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:38,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:38,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a. 2023-02-15 23:01:38,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ef17769adbcffd4b9e090a0403e7dd4a: 2023-02-15 23:01:38,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a. 2023-02-15 23:01:38,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ef42f0baedb02ca105755e274e954d6a: 2023-02-15 23:01:38,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:38,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:38,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 498f2da6b4a7b12b99403e474e841cee, disabling compactions & flushes 2023-02-15 23:01:38,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:38,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:38,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. after waiting 0 ms 2023-02-15 23:01:38,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:38,432 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=ef17769adbcffd4b9e090a0403e7dd4a, regionState=CLOSED 2023-02-15 23:01:38,432 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098432"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502098432"}]},"ts":"1676502098432"} 2023-02-15 23:01:38,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:38,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:38,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 94714b23b200be2464cbfd2bde7728e7, disabling compactions & flushes 2023-02-15 23:01:38,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:38,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:38,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. after waiting 0 ms 2023-02-15 23:01:38,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:38,433 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ef42f0baedb02ca105755e274e954d6a, regionState=CLOSED 2023-02-15 23:01:38,433 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098433"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502098433"}]},"ts":"1676502098433"} 2023-02-15 23:01:38,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=35 2023-02-15 23:01:38,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=35, state=SUCCESS; CloseRegionProcedure ef17769adbcffd4b9e090a0403e7dd4a, server=jenkins-hbase4.apache.org,37411,1676502093966 in 162 msec 2023-02-15 23:01:38,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-15 23:01:38,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure ef42f0baedb02ca105755e274e954d6a, server=jenkins-hbase4.apache.org,37799,1676502093940 in 153 msec 2023-02-15 23:01:38,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef17769adbcffd4b9e090a0403e7dd4a, UNASSIGN in 168 msec 2023-02-15 23:01:38,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ef42f0baedb02ca105755e274e954d6a, UNASSIGN in 168 msec 2023-02-15 23:01:38,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:38,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 23:01:38,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee. 2023-02-15 23:01:38,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7. 2023-02-15 23:01:38,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 498f2da6b4a7b12b99403e474e841cee: 2023-02-15 23:01:38,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 94714b23b200be2464cbfd2bde7728e7: 2023-02-15 23:01:38,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:38,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:38,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9be0ccb017aa72d71b3f6f2b4d528bbf, disabling compactions & flushes 2023-02-15 23:01:38,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:38,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:38,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. after waiting 0 ms 2023-02-15 23:01:38,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:38,441 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=94714b23b200be2464cbfd2bde7728e7, regionState=CLOSED 2023-02-15 23:01:38,441 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676502098441"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502098441"}]},"ts":"1676502098441"} 2023-02-15 23:01:38,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:38,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:38,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c5529c81671502769bca83930b3ef9c3, disabling compactions & flushes 2023-02-15 23:01:38,442 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=498f2da6b4a7b12b99403e474e841cee, regionState=CLOSED 2023-02-15 23:01:38,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:38,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:38,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. after waiting 0 ms 2023-02-15 23:01:38,442 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098442"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502098442"}]},"ts":"1676502098442"} 2023-02-15 23:01:38,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:38,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-02-15 23:01:38,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; CloseRegionProcedure 94714b23b200be2464cbfd2bde7728e7, server=jenkins-hbase4.apache.org,37799,1676502093940 in 172 msec 2023-02-15 23:01:38,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-15 23:01:38,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 498f2da6b4a7b12b99403e474e841cee, server=jenkins-hbase4.apache.org,37411,1676502093966 in 164 msec 2023-02-15 23:01:38,445 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=94714b23b200be2464cbfd2bde7728e7, UNASSIGN in 177 msec 2023-02-15 23:01:38,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 23:01:38,446 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=498f2da6b4a7b12b99403e474e841cee, UNASSIGN in 178 msec 2023-02-15 23:01:38,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf. 2023-02-15 23:01:38,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9be0ccb017aa72d71b3f6f2b4d528bbf: 2023-02-15 23:01:38,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:38,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:38,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ba3aee43e72569c4a8cb9c546efb6f3f, disabling compactions & flushes 2023-02-15 23:01:38,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:38,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:38,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. after waiting 0 ms 2023-02-15 23:01:38,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:38,448 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=9be0ccb017aa72d71b3f6f2b4d528bbf, regionState=CLOSED 2023-02-15 23:01:38,448 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676502098448"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502098448"}]},"ts":"1676502098448"} 2023-02-15 23:01:38,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:38,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=34 2023-02-15 23:01:38,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=34, state=SUCCESS; CloseRegionProcedure 9be0ccb017aa72d71b3f6f2b4d528bbf, server=jenkins-hbase4.apache.org,37799,1676502093940 in 177 msec 2023-02-15 23:01:38,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3. 2023-02-15 23:01:38,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c5529c81671502769bca83930b3ef9c3: 2023-02-15 23:01:38,452 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9be0ccb017aa72d71b3f6f2b4d528bbf, UNASSIGN in 184 msec 2023-02-15 23:01:38,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:38,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:38,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e45ebaf46b12dc5f0978933ed3e5d2d0, disabling compactions & flushes 2023-02-15 23:01:38,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:38,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:38,453 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c5529c81671502769bca83930b3ef9c3, regionState=CLOSED 2023-02-15 23:01:38,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. after waiting 0 ms 2023-02-15 23:01:38,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:38,453 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098453"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502098453"}]},"ts":"1676502098453"} 2023-02-15 23:01:38,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:38,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f. 2023-02-15 23:01:38,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ba3aee43e72569c4a8cb9c546efb6f3f: 2023-02-15 23:01:38,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=37 2023-02-15 23:01:38,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=37, state=SUCCESS; CloseRegionProcedure c5529c81671502769bca83930b3ef9c3, server=jenkins-hbase4.apache.org,37411,1676502093966 in 184 msec 2023-02-15 23:01:38,457 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c5529c81671502769bca83930b3ef9c3, UNASSIGN in 189 msec 2023-02-15 23:01:38,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:38,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:38,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 34fc5c64f675227c7d2471a10e261971, disabling compactions & flushes 2023-02-15 23:01:38,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:38,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:38,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. after waiting 0 ms 2023-02-15 23:01:38,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:38,457 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=ba3aee43e72569c4a8cb9c546efb6f3f, regionState=CLOSED 2023-02-15 23:01:38,457 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098457"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502098457"}]},"ts":"1676502098457"} 2023-02-15 23:01:38,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:38,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-15 23:01:38,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure ba3aee43e72569c4a8cb9c546efb6f3f, server=jenkins-hbase4.apache.org,37799,1676502093940 in 179 msec 2023-02-15 23:01:38,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0. 2023-02-15 23:01:38,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e45ebaf46b12dc5f0978933ed3e5d2d0: 2023-02-15 23:01:38,461 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ba3aee43e72569c4a8cb9c546efb6f3f, UNASSIGN in 193 msec 2023-02-15 23:01:38,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:38,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:38,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:38,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e81ac83dd74dda68998ba3892f54397d, disabling compactions & flushes 2023-02-15 23:01:38,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:38,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:38,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. after waiting 0 ms 2023-02-15 23:01:38,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:38,462 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e45ebaf46b12dc5f0978933ed3e5d2d0, regionState=CLOSED 2023-02-15 23:01:38,462 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098462"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502098462"}]},"ts":"1676502098462"} 2023-02-15 23:01:38,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971. 2023-02-15 23:01:38,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 34fc5c64f675227c7d2471a10e261971: 2023-02-15 23:01:38,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:38,464 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=34fc5c64f675227c7d2471a10e261971, regionState=CLOSED 2023-02-15 23:01:38,464 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098464"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502098464"}]},"ts":"1676502098464"} 2023-02-15 23:01:38,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=36 2023-02-15 23:01:38,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=36, state=SUCCESS; CloseRegionProcedure e45ebaf46b12dc5f0978933ed3e5d2d0, server=jenkins-hbase4.apache.org,37411,1676502093966 in 191 msec 2023-02-15 23:01:38,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e45ebaf46b12dc5f0978933ed3e5d2d0, UNASSIGN in 198 msec 2023-02-15 23:01:38,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-15 23:01:38,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 34fc5c64f675227c7d2471a10e261971, server=jenkins-hbase4.apache.org,37799,1676502093940 in 185 msec 2023-02-15 23:01:38,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=34fc5c64f675227c7d2471a10e261971, UNASSIGN in 200 msec 2023-02-15 23:01:38,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:38,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d. 2023-02-15 23:01:38,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e81ac83dd74dda68998ba3892f54397d: 2023-02-15 23:01:38,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:38,470 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=e81ac83dd74dda68998ba3892f54397d, regionState=CLOSED 2023-02-15 23:01:38,470 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676502098470"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502098470"}]},"ts":"1676502098470"} 2023-02-15 23:01:38,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-15 23:01:38,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure e81ac83dd74dda68998ba3892f54397d, server=jenkins-hbase4.apache.org,37411,1676502093966 in 193 msec 2023-02-15 23:01:38,473 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=33 2023-02-15 23:01:38,473 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e81ac83dd74dda68998ba3892f54397d, UNASSIGN in 205 msec 2023-02-15 23:01:38,474 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502098474"}]},"ts":"1676502098474"} 2023-02-15 23:01:38,475 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-15 23:01:38,476 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-15 23:01:38,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 217 msec 2023-02-15 23:01:38,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 23:01:38,566 INFO [Listener at localhost/36203] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-15 23:01:38,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-15 23:01:38,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:38,570 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:38,570 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:38,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 23:01:38,580 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:38,580 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:38,580 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:38,580 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:38,580 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:38,580 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:38,580 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:38,580 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:38,583 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/recovered.edits] 2023-02-15 23:01:38,584 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/recovered.edits] 2023-02-15 23:01:38,584 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/recovered.edits] 2023-02-15 23:01:38,585 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/recovered.edits] 2023-02-15 23:01:38,585 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf/f1, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf/f2, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf/recovered.edits] 2023-02-15 23:01:38,585 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/recovered.edits] 2023-02-15 23:01:38,585 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/recovered.edits] 2023-02-15 23:01:38,586 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/recovered.edits] 2023-02-15 23:01:38,592 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1/0236955c4d294001889da562884bac4a to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1/0236955c4d294001889da562884bac4a 2023-02-15 23:01:38,593 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1/4f5d9a180b984409a6f588c47f644592 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1/4f5d9a180b984409a6f588c47f644592 2023-02-15 23:01:38,595 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1/8ffaf57bdb984c1885b0c96c2f0a0bb4 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1/8ffaf57bdb984c1885b0c96c2f0a0bb4 2023-02-15 23:01:38,595 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1/71d1f37ca38749a2b56c23ec493eb7a7 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f1/71d1f37ca38749a2b56c23ec493eb7a7 2023-02-15 23:01:38,596 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1/768f6c2ed29a4bd2bd8a7462fb909a3e to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1/768f6c2ed29a4bd2bd8a7462fb909a3e 2023-02-15 23:01:38,604 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1/a6be041e73d442569bd9e486f3944159 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1/a6be041e73d442569bd9e486f3944159 2023-02-15 23:01:38,605 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1/71540165f77245fe98277cf48a6a18a4 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f1/71540165f77245fe98277cf48a6a18a4 2023-02-15 23:01:38,606 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1/0dd2074330b249aaa233659df5517561 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1/0dd2074330b249aaa233659df5517561 2023-02-15 23:01:38,606 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1/c8e43fdea77f46258026d286581bfa58 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f1/c8e43fdea77f46258026d286581bfa58 2023-02-15 23:01:38,606 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1/f638714f241542b286665476223e67e8 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f1/f638714f241542b286665476223e67e8 2023-02-15 23:01:38,607 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1/9fcdc046e58f4704abae6366e56e8bff to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1/9fcdc046e58f4704abae6366e56e8bff 2023-02-15 23:01:38,609 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1/e2f055f5d7a546bd9554fd011e5d0ff5 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f1/e2f055f5d7a546bd9554fd011e5d0ff5 2023-02-15 23:01:38,609 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1/fc70cfa1b00d4a35ba626a3271bf9460 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f1/fc70cfa1b00d4a35ba626a3271bf9460 2023-02-15 23:01:38,609 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf/recovered.edits/6.seqid to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf/recovered.edits/6.seqid 2023-02-15 23:01:38,610 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1/b63b3dc93a6246fda14b6c4478515216 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f1/b63b3dc93a6246fda14b6c4478515216 2023-02-15 23:01:38,610 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2/0e4b2c171a6b4b4e9325a9aff067f8eb to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2/0e4b2c171a6b4b4e9325a9aff067f8eb 2023-02-15 23:01:38,610 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/9be0ccb017aa72d71b3f6f2b4d528bbf 2023-02-15 23:01:38,610 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:38,612 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2/5b0b4db82f30479d8f770fddbe8cfdef to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2/5b0b4db82f30479d8f770fddbe8cfdef 2023-02-15 23:01:38,612 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2/d72da46bfe714aa88b7d6ef622feb6c1 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2/d72da46bfe714aa88b7d6ef622feb6c1 2023-02-15 23:01:38,612 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2/8021e907c43245d5813deb310b0bc1a4 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/f2/8021e907c43245d5813deb310b0bc1a4 2023-02-15 23:01:38,613 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2/b7d1b17519214fcaa756ee2a3a9aa812 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2/b7d1b17519214fcaa756ee2a3a9aa812 2023-02-15 23:01:38,613 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/recovered.edits] 2023-02-15 23:01:38,614 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2/91f127516fc34a1b9cb5e1b97f10d13c to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/f2/91f127516fc34a1b9cb5e1b97f10d13c 2023-02-15 23:01:38,614 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2/ebfed9997ca74566b7145df1fc4b7a85 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/f2/ebfed9997ca74566b7145df1fc4b7a85 2023-02-15 23:01:38,615 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2/252321992d4245be8205ed532afde168 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2/252321992d4245be8205ed532afde168 2023-02-15 23:01:38,615 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2/20f4b3a5a4a04d9d9de136c7042e9e4e to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2/20f4b3a5a4a04d9d9de136c7042e9e4e 2023-02-15 23:01:38,615 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2/7fd4aa6baf10477bacd9ea35dd5d83e2 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2/7fd4aa6baf10477bacd9ea35dd5d83e2 2023-02-15 23:01:38,617 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2/bb290506d5594aada93701bdb3c40756 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/f2/bb290506d5594aada93701bdb3c40756 2023-02-15 23:01:38,617 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2/a45bb06e4a3c4c86b3a3d1584b5a6214 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/f2/a45bb06e4a3c4c86b3a3d1584b5a6214 2023-02-15 23:01:38,618 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2/e88f5774f7704502b2d8abb4c55a9847 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/f2/e88f5774f7704502b2d8abb4c55a9847 2023-02-15 23:01:38,618 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/recovered.edits/12.seqid to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a/recovered.edits/12.seqid 2023-02-15 23:01:38,618 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2/7b53773e4b024a66be576d1413bc9098 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/f2/7b53773e4b024a66be576d1413bc9098 2023-02-15 23:01:38,619 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef17769adbcffd4b9e090a0403e7dd4a 2023-02-15 23:01:38,619 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:38,620 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/recovered.edits/12.seqid to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971/recovered.edits/12.seqid 2023-02-15 23:01:38,621 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/recovered.edits/12.seqid to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f/recovered.edits/12.seqid 2023-02-15 23:01:38,622 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7/f1, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7/f2, FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7/recovered.edits] 2023-02-15 23:01:38,622 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/34fc5c64f675227c7d2471a10e261971 2023-02-15 23:01:38,622 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1/14a747f402c6487ba17164327f8e1d04 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1/14a747f402c6487ba17164327f8e1d04 2023-02-15 23:01:38,622 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ba3aee43e72569c4a8cb9c546efb6f3f 2023-02-15 23:01:38,623 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/recovered.edits/12.seqid to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a/recovered.edits/12.seqid 2023-02-15 23:01:38,623 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/recovered.edits/12.seqid to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee/recovered.edits/12.seqid 2023-02-15 23:01:38,624 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/recovered.edits/12.seqid to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3/recovered.edits/12.seqid 2023-02-15 23:01:38,624 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/ef42f0baedb02ca105755e274e954d6a 2023-02-15 23:01:38,624 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/498f2da6b4a7b12b99403e474e841cee 2023-02-15 23:01:38,625 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/c5529c81671502769bca83930b3ef9c3 2023-02-15 23:01:38,625 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1/b6cdcd3da38f425490f508082443ed32 to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f1/b6cdcd3da38f425490f508082443ed32 2023-02-15 23:01:38,625 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/recovered.edits/12.seqid to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0/recovered.edits/12.seqid 2023-02-15 23:01:38,626 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e45ebaf46b12dc5f0978933ed3e5d2d0 2023-02-15 23:01:38,628 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2/14162b4109ba445a9fb9dfd903dfb11c to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2/14162b4109ba445a9fb9dfd903dfb11c 2023-02-15 23:01:38,629 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7/recovered.edits/6.seqid to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7/recovered.edits/6.seqid 2023-02-15 23:01:38,630 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2/d16d5f87336844a0a6b149a83430d7af to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/f2/d16d5f87336844a0a6b149a83430d7af 2023-02-15 23:01:38,630 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/94714b23b200be2464cbfd2bde7728e7 2023-02-15 23:01:38,633 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/recovered.edits/12.seqid to hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/archive/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d/recovered.edits/12.seqid 2023-02-15 23:01:38,633 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/.tmp/data/default/testWithMockedMapReduceMultiRegion/e81ac83dd74dda68998ba3892f54397d 2023-02-15 23:01:38,633 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-15 23:01:38,635 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:38,638 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-15 23:01:38,641 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-15 23:01:38,642 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:38,642 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-15 23:01:38,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502098642"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:38,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502098642"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:38,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502098642"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:38,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502098642"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:38,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502098642"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:38,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502098642"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:38,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502098642"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:38,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502098642"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:38,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502098642"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:38,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502098642"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:38,644 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-15 23:01:38,644 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9be0ccb017aa72d71b3f6f2b4d528bbf, NAME => 'testWithMockedMapReduceMultiRegion,,1676502095204.9be0ccb017aa72d71b3f6f2b4d528bbf.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => ef17769adbcffd4b9e090a0403e7dd4a, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676502095204.ef17769adbcffd4b9e090a0403e7dd4a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => e45ebaf46b12dc5f0978933ed3e5d2d0, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676502095204.e45ebaf46b12dc5f0978933ed3e5d2d0.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => c5529c81671502769bca83930b3ef9c3, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676502095204.c5529c81671502769bca83930b3ef9c3.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => ef42f0baedb02ca105755e274e954d6a, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676502095204.ef42f0baedb02ca105755e274e954d6a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 34fc5c64f675227c7d2471a10e261971, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676502095204.34fc5c64f675227c7d2471a10e261971.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 498f2da6b4a7b12b99403e474e841cee, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676502095204.498f2da6b4a7b12b99403e474e841cee.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => ba3aee43e72569c4a8cb9c546efb6f3f, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676502095204.ba3aee43e72569c4a8cb9c546efb6f3f.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => e81ac83dd74dda68998ba3892f54397d, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676502095204.e81ac83dd74dda68998ba3892f54397d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 94714b23b200be2464cbfd2bde7728e7, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676502095204.94714b23b200be2464cbfd2bde7728e7.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-15 23:01:38,644 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-15 23:01:38,644 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676502098644"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:38,646 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-15 23:01:38,649 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 23:01:38,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 82 msec 2023-02-15 23:01:38,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38835] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 23:01:38,672 INFO [Listener at localhost/36203] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-15 23:01:38,672 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 23:01:38,672 INFO [Listener at localhost/36203] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 23:01:38,673 DEBUG [Listener at localhost/36203] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25dc3bd3 to 127.0.0.1:55667 2023-02-15 23:01:38,673 DEBUG [Listener at localhost/36203] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:38,673 DEBUG [Listener at localhost/36203] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 23:01:38,673 DEBUG [Listener at localhost/36203] util.JVMClusterUtil(257): Found active master hash=836524492, stopped=false 2023-02-15 23:01:38,673 INFO [Listener at localhost/36203] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38835,1676502093892 2023-02-15 23:01:38,675 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:38,675 INFO [Listener at localhost/36203] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 23:01:38,675 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:38,675 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:38,675 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:38,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:38,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:38,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:38,680 DEBUG [Listener at localhost/36203] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51ba3076 to 127.0.0.1:55667 2023-02-15 23:01:38,680 DEBUG [Listener at localhost/36203] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:38,681 INFO [Listener at localhost/36203] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37799,1676502093940' ***** 2023-02-15 23:01:38,681 INFO [Listener at localhost/36203] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:38,681 INFO [Listener at localhost/36203] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37411,1676502093966' ***** 2023-02-15 23:01:38,681 INFO [Listener at localhost/36203] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:38,681 INFO [RS:1;jenkins-hbase4:37411] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:38,681 INFO [RS:0;jenkins-hbase4:37799] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:38,681 INFO [RS:1;jenkins-hbase4:37411] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:38,681 INFO [RS:0;jenkins-hbase4:37799] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:38,681 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:38,681 INFO [RS:0;jenkins-hbase4:37799] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:38,682 INFO [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(3304): Received CLOSE for 27d53ea1cf641baff3aed42d8892f4aa 2023-02-15 23:01:38,682 INFO [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:38,682 DEBUG [RS:0;jenkins-hbase4:37799] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73df3157 to 127.0.0.1:55667 2023-02-15 23:01:38,681 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:38,683 DEBUG [RS:0;jenkins-hbase4:37799] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:38,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 27d53ea1cf641baff3aed42d8892f4aa, disabling compactions & flushes 2023-02-15 23:01:38,684 INFO [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 23:01:38,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. 2023-02-15 23:01:38,681 INFO [RS:1;jenkins-hbase4:37411] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:38,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. 2023-02-15 23:01:38,684 INFO [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:38,684 DEBUG [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(1479): Online Regions={27d53ea1cf641baff3aed42d8892f4aa=hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa.} 2023-02-15 23:01:38,684 DEBUG [RS:1;jenkins-hbase4:37411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x360a9ea6 to 127.0.0.1:55667 2023-02-15 23:01:38,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. after waiting 0 ms 2023-02-15 23:01:38,684 DEBUG [RS:1;jenkins-hbase4:37411] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:38,684 DEBUG [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(1505): Waiting on 27d53ea1cf641baff3aed42d8892f4aa 2023-02-15 23:01:38,684 INFO [RS:1;jenkins-hbase4:37411] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:38,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. 2023-02-15 23:01:38,684 INFO [RS:1;jenkins-hbase4:37411] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:38,685 INFO [RS:1;jenkins-hbase4:37411] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:38,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 27d53ea1cf641baff3aed42d8892f4aa 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 23:01:38,685 INFO [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 23:01:38,685 INFO [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 23:01:38,685 DEBUG [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-15 23:01:38,685 DEBUG [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 23:01:38,687 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:38,688 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:38,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:38,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:38,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:38,688 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-15 23:01:38,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/namespace/27d53ea1cf641baff3aed42d8892f4aa/.tmp/info/f22c0892281647e7bc8d561c5b00f443 2023-02-15 23:01:38,696 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/.tmp/info/4df1d2d286c74a49912ca266eed55520 2023-02-15 23:01:38,700 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4df1d2d286c74a49912ca266eed55520 2023-02-15 23:01:38,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/namespace/27d53ea1cf641baff3aed42d8892f4aa/.tmp/info/f22c0892281647e7bc8d561c5b00f443 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/namespace/27d53ea1cf641baff3aed42d8892f4aa/info/f22c0892281647e7bc8d561c5b00f443 2023-02-15 23:01:38,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/namespace/27d53ea1cf641baff3aed42d8892f4aa/info/f22c0892281647e7bc8d561c5b00f443, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 23:01:38,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 27d53ea1cf641baff3aed42d8892f4aa in 22ms, sequenceid=6, compaction requested=false 2023-02-15 23:01:38,726 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/.tmp/rep_barrier/0fea15c635604cb4ba9d7726da903e60 2023-02-15 23:01:38,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/namespace/27d53ea1cf641baff3aed42d8892f4aa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 23:01:38,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. 2023-02-15 23:01:38,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 27d53ea1cf641baff3aed42d8892f4aa: 2023-02-15 23:01:38,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676502094558.27d53ea1cf641baff3aed42d8892f4aa. 2023-02-15 23:01:38,730 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0fea15c635604cb4ba9d7726da903e60 2023-02-15 23:01:38,736 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/.tmp/table/44f50fc2313e4dfca6bdae50bc3cf2a1 2023-02-15 23:01:38,740 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44f50fc2313e4dfca6bdae50bc3cf2a1 2023-02-15 23:01:38,740 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/.tmp/info/4df1d2d286c74a49912ca266eed55520 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/info/4df1d2d286c74a49912ca266eed55520 2023-02-15 23:01:38,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4df1d2d286c74a49912ca266eed55520 2023-02-15 23:01:38,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/info/4df1d2d286c74a49912ca266eed55520, entries=30, sequenceid=57, filesize=8.3 K 2023-02-15 23:01:38,745 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/.tmp/rep_barrier/0fea15c635604cb4ba9d7726da903e60 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/rep_barrier/0fea15c635604cb4ba9d7726da903e60 2023-02-15 23:01:38,745 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:38,749 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0fea15c635604cb4ba9d7726da903e60 2023-02-15 23:01:38,749 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/rep_barrier/0fea15c635604cb4ba9d7726da903e60, entries=10, sequenceid=57, filesize=6.1 K 2023-02-15 23:01:38,750 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/.tmp/table/44f50fc2313e4dfca6bdae50bc3cf2a1 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/table/44f50fc2313e4dfca6bdae50bc3cf2a1 2023-02-15 23:01:38,752 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:38,754 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44f50fc2313e4dfca6bdae50bc3cf2a1 2023-02-15 23:01:38,754 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/table/44f50fc2313e4dfca6bdae50bc3cf2a1, entries=13, sequenceid=57, filesize=6.1 K 2023-02-15 23:01:38,755 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 67ms, sequenceid=57, compaction requested=false 2023-02-15 23:01:38,758 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-15 23:01:38,758 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 23:01:38,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:38,759 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:38,759 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:38,884 INFO [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37799,1676502093940; all regions closed. 2023-02-15 23:01:38,888 INFO [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37411,1676502093966; all regions closed. 2023-02-15 23:01:38,891 DEBUG [RS:0;jenkins-hbase4:37799] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/oldWALs 2023-02-15 23:01:38,891 INFO [RS:0;jenkins-hbase4:37799] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37799%2C1676502093940:(num 1676502094922) 2023-02-15 23:01:38,891 DEBUG [RS:0;jenkins-hbase4:37799] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:38,891 INFO [RS:0;jenkins-hbase4:37799] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:38,892 INFO [RS:0;jenkins-hbase4:37799] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:38,892 INFO [RS:0;jenkins-hbase4:37799] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:38,892 INFO [RS:0;jenkins-hbase4:37799] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:38,892 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:38,892 INFO [RS:0;jenkins-hbase4:37799] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:38,893 INFO [RS:0;jenkins-hbase4:37799] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37799 2023-02-15 23:01:38,893 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/WALs/jenkins-hbase4.apache.org,37411,1676502093966/jenkins-hbase4.apache.org%2C37411%2C1676502093966.meta.1676502094490.meta not finished, retry = 0 2023-02-15 23:01:38,894 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:38,895 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:38,895 ERROR [Listener at localhost/36203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@969f8d8 rejected from java.util.concurrent.ThreadPoolExecutor@d566d2d[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:38,895 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37799,1676502093940 2023-02-15 23:01:38,895 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:38,895 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:38,895 ERROR [Listener at localhost/36203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3fbf995a rejected from java.util.concurrent.ThreadPoolExecutor@d566d2d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:38,896 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37799,1676502093940] 2023-02-15 23:01:38,896 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37799,1676502093940; numProcessing=1 2023-02-15 23:01:38,898 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37799,1676502093940 already deleted, retry=false 2023-02-15 23:01:38,898 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37799,1676502093940 expired; onlineServers=1 2023-02-15 23:01:38,995 DEBUG [RS:1;jenkins-hbase4:37411] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/oldWALs 2023-02-15 23:01:38,995 INFO [RS:1;jenkins-hbase4:37411] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37411%2C1676502093966.meta:.meta(num 1676502094490) 2023-02-15 23:01:39,000 DEBUG [RS:1;jenkins-hbase4:37411] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/oldWALs 2023-02-15 23:01:39,000 INFO [RS:1;jenkins-hbase4:37411] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37411%2C1676502093966:(num 1676502095266) 2023-02-15 23:01:39,000 DEBUG [RS:1;jenkins-hbase4:37411] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:39,000 INFO [RS:1;jenkins-hbase4:37411] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:39,000 INFO [RS:1;jenkins-hbase4:37411] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:39,000 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:39,001 INFO [RS:1;jenkins-hbase4:37411] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37411 2023-02-15 23:01:39,002 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37411,1676502093966 2023-02-15 23:01:39,002 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:39,003 ERROR [Listener at localhost/36203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13e4f5ac rejected from java.util.concurrent.ThreadPoolExecutor@17db7308[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:39,004 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37411,1676502093966] 2023-02-15 23:01:39,004 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37411,1676502093966; numProcessing=2 2023-02-15 23:01:39,005 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37411,1676502093966 already deleted, retry=false 2023-02-15 23:01:39,005 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37411,1676502093966 expired; onlineServers=0 2023-02-15 23:01:39,005 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38835,1676502093892' ***** 2023-02-15 23:01:39,005 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 23:01:39,005 DEBUG [M:0;jenkins-hbase4:38835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35e3db2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:39,005 INFO [M:0;jenkins-hbase4:38835] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38835,1676502093892 2023-02-15 23:01:39,006 INFO [M:0;jenkins-hbase4:38835] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38835,1676502093892; all regions closed. 2023-02-15 23:01:39,006 DEBUG [M:0;jenkins-hbase4:38835] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:39,006 DEBUG [M:0;jenkins-hbase4:38835] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 23:01:39,006 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 23:01:39,006 DEBUG [M:0;jenkins-hbase4:38835] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 23:01:39,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502094136] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502094136,5,FailOnTimeoutGroup] 2023-02-15 23:01:39,006 INFO [M:0;jenkins-hbase4:38835] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 23:01:39,006 INFO [M:0;jenkins-hbase4:38835] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 23:01:39,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502094136] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502094136,5,FailOnTimeoutGroup] 2023-02-15 23:01:39,007 INFO [M:0;jenkins-hbase4:38835] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 23:01:39,007 DEBUG [M:0;jenkins-hbase4:38835] master.HMaster(1512): Stopping service threads 2023-02-15 23:01:39,007 INFO [M:0;jenkins-hbase4:38835] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 23:01:39,008 ERROR [M:0;jenkins-hbase4:38835] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 23:01:39,008 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:39,008 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:39,008 INFO [M:0;jenkins-hbase4:38835] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 23:01:39,008 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 23:01:39,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:39,008 DEBUG [M:0;jenkins-hbase4:38835] zookeeper.ZKUtil(398): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 23:01:39,008 WARN [M:0;jenkins-hbase4:38835] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 23:01:39,008 INFO [M:0;jenkins-hbase4:38835] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 23:01:39,009 INFO [M:0;jenkins-hbase4:38835] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 23:01:39,009 DEBUG [M:0;jenkins-hbase4:38835] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:39,009 INFO [M:0;jenkins-hbase4:38835] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:39,009 DEBUG [M:0;jenkins-hbase4:38835] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:39,009 DEBUG [M:0;jenkins-hbase4:38835] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:39,009 DEBUG [M:0;jenkins-hbase4:38835] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:39,009 INFO [M:0;jenkins-hbase4:38835] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.15 KB heapSize=200.04 KB 2023-02-15 23:01:39,017 INFO [M:0;jenkins-hbase4:38835] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.15 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5d69c442fe1b498d8a13cc012fab6b29 2023-02-15 23:01:39,021 DEBUG [M:0;jenkins-hbase4:38835] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5d69c442fe1b498d8a13cc012fab6b29 as hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5d69c442fe1b498d8a13cc012fab6b29 2023-02-15 23:01:39,025 INFO [M:0;jenkins-hbase4:38835] regionserver.HStore(1080): Added hdfs://localhost:33779/user/jenkins/test-data/5f61ed0d-4bad-d13e-fd88-a7dd257121dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5d69c442fe1b498d8a13cc012fab6b29, entries=53, sequenceid=357, filesize=10.7 K 2023-02-15 23:01:39,026 INFO [M:0;jenkins-hbase4:38835] regionserver.HRegion(2947): Finished flush of dataSize ~167.15 KB/171165, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false 2023-02-15 23:01:39,026 INFO [M:0;jenkins-hbase4:38835] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:39,026 DEBUG [M:0;jenkins-hbase4:38835] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:39,029 INFO [M:0;jenkins-hbase4:38835] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 23:01:39,029 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:39,030 INFO [M:0;jenkins-hbase4:38835] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38835 2023-02-15 23:01:39,032 DEBUG [M:0;jenkins-hbase4:38835] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38835,1676502093892 already deleted, retry=false 2023-02-15 23:01:39,175 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:39,175 INFO [M:0;jenkins-hbase4:38835] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38835,1676502093892; zookeeper connection closed. 2023-02-15 23:01:39,175 ERROR [Listener at localhost/36203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74cffd80 rejected from java.util.concurrent.ThreadPoolExecutor@70f077c1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:39,176 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): master:38835-0x1005a37b9f10000, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:39,176 ERROR [Listener at localhost/36203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@fa58820 rejected from java.util.concurrent.ThreadPoolExecutor@70f077c1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:39,275 INFO [RS:1;jenkins-hbase4:37411] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37411,1676502093966; zookeeper connection closed. 2023-02-15 23:01:39,275 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:39,275 ERROR [Listener at localhost/36203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@57bccd6c rejected from java.util.concurrent.ThreadPoolExecutor@17db7308[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:39,276 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@191b7cbf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@191b7cbf 2023-02-15 23:01:39,276 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37411-0x1005a37b9f10002, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:39,276 ERROR [Listener at localhost/36203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2f4e67e1 rejected from java.util.concurrent.ThreadPoolExecutor@17db7308[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:39,375 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:39,375 INFO [RS:0;jenkins-hbase4:37799] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37799,1676502093940; zookeeper connection closed. 2023-02-15 23:01:39,376 ERROR [Listener at localhost/36203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47d72c5f rejected from java.util.concurrent.ThreadPoolExecutor@d566d2d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:39,376 DEBUG [Listener at localhost/36203-EventThread] zookeeper.ZKWatcher(600): regionserver:37799-0x1005a37b9f10001, quorum=127.0.0.1:55667, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:39,376 ERROR [Listener at localhost/36203-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b4d34b0 rejected from java.util.concurrent.ThreadPoolExecutor@d566d2d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:39,376 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@86567e9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@86567e9 2023-02-15 23:01:39,377 INFO [Listener at localhost/36203] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 23:01:39,377 WARN [Listener at localhost/36203] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:39,380 INFO [Listener at localhost/36203] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:39,485 WARN [BP-1041520783-172.31.14.131-1676502093303 heartbeating to localhost/127.0.0.1:33779] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 23:01:39,486 WARN [BP-1041520783-172.31.14.131-1676502093303 heartbeating to localhost/127.0.0.1:33779] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1041520783-172.31.14.131-1676502093303 (Datanode Uuid b7bc428b-e982-4c57-9a05-3ad92301ecc1) service to localhost/127.0.0.1:33779 2023-02-15 23:01:39,489 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/cluster_2c2b593f-828c-b9dd-db65-87ecd2e8d178/dfs/data/data3/current/BP-1041520783-172.31.14.131-1676502093303] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:39,489 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/cluster_2c2b593f-828c-b9dd-db65-87ecd2e8d178/dfs/data/data4/current/BP-1041520783-172.31.14.131-1676502093303] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:39,490 WARN [Listener at localhost/36203] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:39,493 INFO [Listener at localhost/36203] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:39,598 WARN [BP-1041520783-172.31.14.131-1676502093303 heartbeating to localhost/127.0.0.1:33779] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 23:01:39,600 WARN [BP-1041520783-172.31.14.131-1676502093303 heartbeating to localhost/127.0.0.1:33779] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1041520783-172.31.14.131-1676502093303 (Datanode Uuid edac5eee-1b14-42b7-9489-856ff1545d32) service to localhost/127.0.0.1:33779 2023-02-15 23:01:39,601 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/cluster_2c2b593f-828c-b9dd-db65-87ecd2e8d178/dfs/data/data1/current/BP-1041520783-172.31.14.131-1676502093303] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:39,602 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/cluster_2c2b593f-828c-b9dd-db65-87ecd2e8d178/dfs/data/data2/current/BP-1041520783-172.31.14.131-1676502093303] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:39,612 INFO [Listener at localhost/36203] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:39,733 INFO [Listener at localhost/36203] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 23:01:39,769 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 23:01:39,784 INFO [Listener at localhost/36203] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=228 (was 178) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36203.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:33779 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:33779 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38835,1676502093892)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36203 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36203.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36203.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36203.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:33779 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36203.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:33779 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/36203.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36203.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:33779 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36203.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33779 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:33779 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/36203.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36203.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=643 (was 569) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=339 (was 342), ProcessCount=166 (was 166), AvailableMemoryMB=2579 (was 2606) 2023-02-15 23:01:39,794 INFO [Listener at localhost/36203] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=228, OpenFileDescriptor=643, MaxFileDescriptor=60000, SystemLoadAverage=339, ProcessCount=166, AvailableMemoryMB=2579 2023-02-15 23:01:39,803 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/hadoop.log.dir so I do NOT create it in target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d 2023-02-15 23:01:39,804 WARN [Listener at localhost/36203] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 23:01:39,804 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/hadoop.tmp.dir so I do NOT create it in target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d 2023-02-15 23:01:39,804 WARN [Listener at localhost/36203] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e51c95fd-9e30-8684-fa36-85eb2fca99ac/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 23:01:39,804 DEBUG [Listener at localhost/36203] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d 2023-02-15 23:01:39,804 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 23:01:39,804 INFO [Listener at localhost/36203] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/cluster_7898d070-e9a8-071d-89b3-c02a750131d4, deleteOnExit=true 2023-02-15 23:01:39,804 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 23:01:39,804 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/test.cache.data in system properties and HBase conf 2023-02-15 23:01:39,804 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 23:01:39,804 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/hadoop.log.dir in system properties and HBase conf 2023-02-15 23:01:39,804 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 23:01:39,805 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 23:01:39,805 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 23:01:39,805 DEBUG [Listener at localhost/36203] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 23:01:39,805 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:01:39,805 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:01:39,805 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 23:01:39,805 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:01:39,805 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 23:01:39,805 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 23:01:39,805 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:01:39,806 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:01:39,806 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 23:01:39,806 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/nfs.dump.dir in system properties and HBase conf 2023-02-15 23:01:39,806 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/java.io.tmpdir in system properties and HBase conf 2023-02-15 23:01:39,806 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:01:39,806 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 23:01:39,806 INFO [Listener at localhost/36203] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 23:01:39,810 WARN [Listener at localhost/36203] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:01:39,810 WARN [Listener at localhost/36203] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:01:39,850 WARN [Listener at localhost/36203] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-15 23:01:39,922 WARN [Listener at localhost/36203] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:39,924 INFO [Listener at localhost/36203] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:39,929 INFO [Listener at localhost/36203] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/java.io.tmpdir/Jetty_localhost_33835_hdfs____e0c6w4/webapp 2023-02-15 23:01:40,020 INFO [Listener at localhost/36203] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33835 2023-02-15 23:01:40,054 WARN [Listener at localhost/36203] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:01:40,054 WARN [Listener at localhost/36203] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:01:40,100 WARN [Listener at localhost/36163] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:40,113 WARN [Listener at localhost/36163] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:01:40,115 WARN [Listener at localhost/36163] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:40,117 INFO [Listener at localhost/36163] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:40,124 INFO [Listener at localhost/36163] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/java.io.tmpdir/Jetty_localhost_34307_datanode____.26nk0w/webapp 2023-02-15 23:01:40,218 INFO [Listener at localhost/36163] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34307 2023-02-15 23:01:40,226 WARN [Listener at localhost/42073] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:40,243 WARN [Listener at localhost/42073] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:01:40,248 WARN [Listener at localhost/42073] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:40,249 INFO [Listener at localhost/42073] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:40,253 INFO [Listener at localhost/42073] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/java.io.tmpdir/Jetty_localhost_46353_datanode____.j339sa/webapp 2023-02-15 23:01:40,342 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2a7450242ead8687: Processing first storage report for DS-0d9598b5-55b4-42ab-a7d0-0e0601cccdf0 from datanode 1494786c-61be-4959-bbe0-ae9328e0aa17 2023-02-15 23:01:40,343 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2a7450242ead8687: from storage DS-0d9598b5-55b4-42ab-a7d0-0e0601cccdf0 node DatanodeRegistration(127.0.0.1:46551, datanodeUuid=1494786c-61be-4959-bbe0-ae9328e0aa17, infoPort=42629, infoSecurePort=0, ipcPort=42073, storageInfo=lv=-57;cid=testClusterID;nsid=792560219;c=1676502099812), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:40,343 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2a7450242ead8687: Processing first storage report for DS-df338224-a4cd-4b4e-8704-935309f6780b from datanode 1494786c-61be-4959-bbe0-ae9328e0aa17 2023-02-15 23:01:40,343 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2a7450242ead8687: from storage DS-df338224-a4cd-4b4e-8704-935309f6780b node DatanodeRegistration(127.0.0.1:46551, datanodeUuid=1494786c-61be-4959-bbe0-ae9328e0aa17, infoPort=42629, infoSecurePort=0, ipcPort=42073, storageInfo=lv=-57;cid=testClusterID;nsid=792560219;c=1676502099812), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:40,357 INFO [Listener at localhost/42073] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46353 2023-02-15 23:01:40,367 WARN [Listener at localhost/35227] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:40,452 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xedaca0187f87e557: Processing first storage report for DS-616b9f14-2e0e-4183-bb83-b09c1d2428ae from datanode f35364ce-81f7-4532-baa5-b97368927d7c 2023-02-15 23:01:40,453 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xedaca0187f87e557: from storage DS-616b9f14-2e0e-4183-bb83-b09c1d2428ae node DatanodeRegistration(127.0.0.1:36811, datanodeUuid=f35364ce-81f7-4532-baa5-b97368927d7c, infoPort=44609, infoSecurePort=0, ipcPort=35227, storageInfo=lv=-57;cid=testClusterID;nsid=792560219;c=1676502099812), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 23:01:40,453 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xedaca0187f87e557: Processing first storage report for DS-76a0986f-4867-4a25-9526-4557774cb69a from datanode f35364ce-81f7-4532-baa5-b97368927d7c 2023-02-15 23:01:40,453 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xedaca0187f87e557: from storage DS-76a0986f-4867-4a25-9526-4557774cb69a node DatanodeRegistration(127.0.0.1:36811, datanodeUuid=f35364ce-81f7-4532-baa5-b97368927d7c, infoPort=44609, infoSecurePort=0, ipcPort=35227, storageInfo=lv=-57;cid=testClusterID;nsid=792560219;c=1676502099812), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:40,477 DEBUG [Listener at localhost/35227] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d 2023-02-15 23:01:40,479 INFO [Listener at localhost/35227] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/cluster_7898d070-e9a8-071d-89b3-c02a750131d4/zookeeper_0, clientPort=50939, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/cluster_7898d070-e9a8-071d-89b3-c02a750131d4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/cluster_7898d070-e9a8-071d-89b3-c02a750131d4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 23:01:40,480 INFO [Listener at localhost/35227] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50939 2023-02-15 23:01:40,480 INFO [Listener at localhost/35227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:40,481 INFO [Listener at localhost/35227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:40,492 INFO [Listener at localhost/35227] util.FSUtils(479): Created version file at hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c with version=8 2023-02-15 23:01:40,492 INFO [Listener at localhost/35227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:40,493 INFO [Listener at localhost/35227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:40,494 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36163/user/jenkins/test-data/8a763974-f24f-291c-cafd-59086d176e75/hbase-staging 2023-02-15 23:01:40,495 INFO [Listener at localhost/35227] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:40,496 INFO [Listener at localhost/35227] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:40,496 INFO [Listener at localhost/35227] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:40,496 INFO [Listener at localhost/35227] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:40,496 INFO [Listener at localhost/35227] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:40,496 INFO [Listener at localhost/35227] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:40,496 INFO [Listener at localhost/35227] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:40,497 INFO [Listener at localhost/35227] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35295 2023-02-15 23:01:40,497 INFO [Listener at localhost/35227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:40,498 INFO [Listener at localhost/35227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:40,498 INFO [Listener at localhost/35227] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35295 connecting to ZooKeeper ensemble=127.0.0.1:50939 2023-02-15 23:01:40,511 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:352950x0, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:40,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35295-0x1005a37d3c30000 connected 2023-02-15 23:01:40,529 DEBUG [Listener at localhost/35227] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:40,530 DEBUG [Listener at localhost/35227] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:40,530 DEBUG [Listener at localhost/35227] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:40,532 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35295 2023-02-15 23:01:40,532 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35295 2023-02-15 23:01:40,534 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35295 2023-02-15 23:01:40,536 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35295 2023-02-15 23:01:40,536 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35295 2023-02-15 23:01:40,536 INFO [Listener at localhost/35227] master.HMaster(444): hbase.rootdir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c, hbase.cluster.distributed=false 2023-02-15 23:01:40,548 INFO [Listener at localhost/35227] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:40,549 INFO [Listener at localhost/35227] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:40,549 INFO [Listener at localhost/35227] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:40,549 INFO [Listener at localhost/35227] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:40,549 INFO [Listener at localhost/35227] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:40,549 INFO [Listener at localhost/35227] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:40,549 INFO [Listener at localhost/35227] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:40,550 INFO [Listener at localhost/35227] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37859 2023-02-15 23:01:40,550 INFO [Listener at localhost/35227] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:40,553 DEBUG [Listener at localhost/35227] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:40,553 INFO [Listener at localhost/35227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:40,554 INFO [Listener at localhost/35227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:40,555 INFO [Listener at localhost/35227] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37859 connecting to ZooKeeper ensemble=127.0.0.1:50939 2023-02-15 23:01:40,558 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:378590x0, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:40,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37859-0x1005a37d3c30001 connected 2023-02-15 23:01:40,559 DEBUG [Listener at localhost/35227] zookeeper.ZKUtil(164): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:40,560 DEBUG [Listener at localhost/35227] zookeeper.ZKUtil(164): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:40,560 DEBUG [Listener at localhost/35227] zookeeper.ZKUtil(164): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:40,561 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37859 2023-02-15 23:01:40,561 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37859 2023-02-15 23:01:40,561 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37859 2023-02-15 23:01:40,561 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37859 2023-02-15 23:01:40,562 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37859 2023-02-15 23:01:40,572 INFO [Listener at localhost/35227] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:40,572 INFO [Listener at localhost/35227] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:40,572 INFO [Listener at localhost/35227] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:40,572 INFO [Listener at localhost/35227] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:40,572 INFO [Listener at localhost/35227] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:40,572 INFO [Listener at localhost/35227] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:40,572 INFO [Listener at localhost/35227] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:40,574 INFO [Listener at localhost/35227] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34947 2023-02-15 23:01:40,574 INFO [Listener at localhost/35227] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:40,576 DEBUG [Listener at localhost/35227] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:40,576 INFO [Listener at localhost/35227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:40,577 INFO [Listener at localhost/35227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:40,578 INFO [Listener at localhost/35227] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34947 connecting to ZooKeeper ensemble=127.0.0.1:50939 2023-02-15 23:01:40,582 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:349470x0, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:40,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34947-0x1005a37d3c30002 connected 2023-02-15 23:01:40,584 DEBUG [Listener at localhost/35227] zookeeper.ZKUtil(164): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:40,584 DEBUG [Listener at localhost/35227] zookeeper.ZKUtil(164): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:40,585 DEBUG [Listener at localhost/35227] zookeeper.ZKUtil(164): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:40,588 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34947 2023-02-15 23:01:40,588 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34947 2023-02-15 23:01:40,588 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34947 2023-02-15 23:01:40,589 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34947 2023-02-15 23:01:40,590 DEBUG [Listener at localhost/35227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34947 2023-02-15 23:01:40,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35295,1676502100495 2023-02-15 23:01:40,594 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:40,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35295,1676502100495 2023-02-15 23:01:40,600 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:40,600 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:40,600 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:40,601 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:40,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:40,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35295,1676502100495 from backup master directory 2023-02-15 23:01:40,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:40,604 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35295,1676502100495 2023-02-15 23:01:40,604 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:40,604 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:40,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35295,1676502100495 2023-02-15 23:01:40,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/hbase.id with ID: cdf6ddea-6628-4c02-a828-7ea15b5eb139 2023-02-15 23:01:40,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:40,626 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:40,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3e19f1d2 to 127.0.0.1:50939 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:40,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51c97e3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:40,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:40,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 23:01:40,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:40,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/MasterData/data/master/store-tmp 2023-02-15 23:01:40,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:40,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:40,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:40,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:40,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:40,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:40,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:40,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:40,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/MasterData/WALs/jenkins-hbase4.apache.org,35295,1676502100495 2023-02-15 23:01:40,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35295%2C1676502100495, suffix=, logDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/MasterData/WALs/jenkins-hbase4.apache.org,35295,1676502100495, archiveDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/MasterData/oldWALs, maxLogs=10 2023-02-15 23:01:40,661 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46551,DS-0d9598b5-55b4-42ab-a7d0-0e0601cccdf0,DISK] 2023-02-15 23:01:40,661 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36811,DS-616b9f14-2e0e-4183-bb83-b09c1d2428ae,DISK] 2023-02-15 23:01:40,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/MasterData/WALs/jenkins-hbase4.apache.org,35295,1676502100495/jenkins-hbase4.apache.org%2C35295%2C1676502100495.1676502100649 2023-02-15 23:01:40,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46551,DS-0d9598b5-55b4-42ab-a7d0-0e0601cccdf0,DISK], DatanodeInfoWithStorage[127.0.0.1:36811,DS-616b9f14-2e0e-4183-bb83-b09c1d2428ae,DISK]] 2023-02-15 23:01:40,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:40,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:40,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:40,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:40,664 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:40,665 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 23:01:40,666 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 23:01:40,666 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:40,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:40,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:40,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:40,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:40,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74956022, jitterRate=0.11693176627159119}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:40,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:40,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 23:01:40,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 23:01:40,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 23:01:40,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 23:01:40,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 23:01:40,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 23:01:40,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 23:01:40,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 23:01:40,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 23:01:40,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 23:01:40,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 23:01:40,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 23:01:40,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 23:01:40,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 23:01:40,689 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:40,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 23:01:40,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 23:01:40,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 23:01:40,692 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:40,692 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:40,692 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:40,692 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:40,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35295,1676502100495, sessionid=0x1005a37d3c30000, setting cluster-up flag (Was=false) 2023-02-15 23:01:40,697 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:40,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 23:01:40,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35295,1676502100495 2023-02-15 23:01:40,705 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:40,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 23:01:40,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35295,1676502100495 2023-02-15 23:01:40,709 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.hbase-snapshot/.tmp 2023-02-15 23:01:40,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:40,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:40,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:40,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:40,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:40,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 23:01:40,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:40,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676502130715 2023-02-15 23:01:40,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 23:01:40,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 23:01:40,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 23:01:40,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 23:01:40,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 23:01:40,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 23:01:40,715 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:40,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,716 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 23:01:40,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 23:01:40,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 23:01:40,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 23:01:40,717 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:40,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 23:01:40,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 23:01:40,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502100720,5,FailOnTimeoutGroup] 2023-02-15 23:01:40,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502100721,5,FailOnTimeoutGroup] 2023-02-15 23:01:40,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 23:01:40,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,725 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:40,726 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:40,726 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c 2023-02-15 23:01:40,735 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:40,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:40,737 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/info 2023-02-15 23:01:40,737 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:40,737 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:40,738 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:40,738 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:40,739 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:40,739 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:40,739 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:40,740 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/table 2023-02-15 23:01:40,740 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:40,741 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:40,741 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740 2023-02-15 23:01:40,741 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740 2023-02-15 23:01:40,743 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:40,744 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:40,745 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:40,745 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59827213, jitterRate=-0.10850505530834198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:40,745 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:40,745 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:40,745 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:40,745 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:40,745 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:40,745 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:40,746 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:40,746 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:40,746 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:40,746 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 23:01:40,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 23:01:40,748 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 23:01:40,749 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 23:01:40,793 INFO [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(952): ClusterId : cdf6ddea-6628-4c02-a828-7ea15b5eb139 2023-02-15 23:01:40,793 INFO [RS:0;jenkins-hbase4:37859] regionserver.HRegionServer(952): ClusterId : cdf6ddea-6628-4c02-a828-7ea15b5eb139 2023-02-15 23:01:40,794 DEBUG [RS:1;jenkins-hbase4:34947] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:40,794 DEBUG [RS:0;jenkins-hbase4:37859] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:40,796 DEBUG [RS:1;jenkins-hbase4:34947] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:40,796 DEBUG [RS:0;jenkins-hbase4:37859] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:40,796 DEBUG [RS:0;jenkins-hbase4:37859] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:40,796 DEBUG [RS:1;jenkins-hbase4:34947] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:40,798 DEBUG [RS:0;jenkins-hbase4:37859] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:40,800 DEBUG [RS:1;jenkins-hbase4:34947] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:40,800 DEBUG [RS:0;jenkins-hbase4:37859] zookeeper.ReadOnlyZKClient(139): Connect 0x4f1ad076 to 127.0.0.1:50939 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:40,801 DEBUG [RS:1;jenkins-hbase4:34947] zookeeper.ReadOnlyZKClient(139): Connect 0x58bf2dfe to 127.0.0.1:50939 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:40,807 DEBUG [RS:0;jenkins-hbase4:37859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41dd27e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:40,807 DEBUG [RS:1;jenkins-hbase4:34947] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5678d899, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:40,807 DEBUG [RS:0;jenkins-hbase4:37859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45e2bb06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:40,807 DEBUG [RS:1;jenkins-hbase4:34947] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5247468e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:40,816 DEBUG [RS:1;jenkins-hbase4:34947] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34947 2023-02-15 23:01:40,816 DEBUG [RS:0;jenkins-hbase4:37859] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37859 2023-02-15 23:01:40,816 INFO [RS:1;jenkins-hbase4:34947] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:40,816 INFO [RS:1;jenkins-hbase4:34947] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:40,816 INFO [RS:0;jenkins-hbase4:37859] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:40,816 INFO [RS:0;jenkins-hbase4:37859] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:40,816 DEBUG [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:40,816 DEBUG [RS:0;jenkins-hbase4:37859] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:40,816 INFO [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35295,1676502100495 with isa=jenkins-hbase4.apache.org/172.31.14.131:34947, startcode=1676502100571 2023-02-15 23:01:40,816 INFO [RS:0;jenkins-hbase4:37859] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35295,1676502100495 with isa=jenkins-hbase4.apache.org/172.31.14.131:37859, startcode=1676502100548 2023-02-15 23:01:40,816 DEBUG [RS:1;jenkins-hbase4:34947] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:40,817 DEBUG [RS:0;jenkins-hbase4:37859] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:40,818 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37205, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:40,818 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42341, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:40,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35295] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:40,820 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:40,820 DEBUG [RS:0;jenkins-hbase4:37859] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c 2023-02-15 23:01:40,820 DEBUG [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c 2023-02-15 23:01:40,820 DEBUG [RS:0;jenkins-hbase4:37859] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36163 2023-02-15 23:01:40,821 DEBUG [RS:0;jenkins-hbase4:37859] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:40,820 DEBUG [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36163 2023-02-15 23:01:40,821 DEBUG [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:40,824 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:40,824 DEBUG [RS:1;jenkins-hbase4:34947] zookeeper.ZKUtil(162): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:40,824 DEBUG [RS:0;jenkins-hbase4:37859] zookeeper.ZKUtil(162): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:40,825 WARN [RS:1;jenkins-hbase4:34947] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:40,825 WARN [RS:0;jenkins-hbase4:37859] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:40,825 INFO [RS:1;jenkins-hbase4:34947] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:40,825 INFO [RS:0;jenkins-hbase4:37859] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:40,825 DEBUG [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/WALs/jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:40,825 DEBUG [RS:0;jenkins-hbase4:37859] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/WALs/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:40,825 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34947,1676502100571] 2023-02-15 23:01:40,825 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37859,1676502100548] 2023-02-15 23:01:40,831 DEBUG [RS:1;jenkins-hbase4:34947] zookeeper.ZKUtil(162): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:40,831 DEBUG [RS:0;jenkins-hbase4:37859] zookeeper.ZKUtil(162): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:40,831 DEBUG [RS:1;jenkins-hbase4:34947] zookeeper.ZKUtil(162): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:40,831 DEBUG [RS:0;jenkins-hbase4:37859] zookeeper.ZKUtil(162): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:40,832 DEBUG [RS:1;jenkins-hbase4:34947] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:40,832 DEBUG [RS:0;jenkins-hbase4:37859] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:40,832 INFO [RS:1;jenkins-hbase4:34947] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:40,832 INFO [RS:0;jenkins-hbase4:37859] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:40,833 INFO [RS:1;jenkins-hbase4:34947] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:40,833 INFO [RS:1;jenkins-hbase4:34947] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:40,833 INFO [RS:1;jenkins-hbase4:34947] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,834 INFO [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:40,835 INFO [RS:0;jenkins-hbase4:37859] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:40,835 INFO [RS:1;jenkins-hbase4:34947] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,841 INFO [RS:0;jenkins-hbase4:37859] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:40,841 DEBUG [RS:1;jenkins-hbase4:34947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,841 INFO [RS:0;jenkins-hbase4:37859] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,841 DEBUG [RS:1;jenkins-hbase4:34947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,841 DEBUG [RS:1;jenkins-hbase4:34947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,841 DEBUG [RS:1;jenkins-hbase4:34947] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,841 DEBUG [RS:1;jenkins-hbase4:34947] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,841 INFO [RS:0;jenkins-hbase4:37859] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:40,841 DEBUG [RS:1;jenkins-hbase4:34947] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:40,842 DEBUG [RS:1;jenkins-hbase4:34947] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,842 DEBUG [RS:1;jenkins-hbase4:34947] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,842 DEBUG [RS:1;jenkins-hbase4:34947] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,842 DEBUG [RS:1;jenkins-hbase4:34947] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,842 INFO [RS:1;jenkins-hbase4:34947] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,843 INFO [RS:0;jenkins-hbase4:37859] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,843 INFO [RS:1;jenkins-hbase4:34947] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,843 DEBUG [RS:0;jenkins-hbase4:37859] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,843 INFO [RS:1;jenkins-hbase4:34947] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,843 DEBUG [RS:0;jenkins-hbase4:37859] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,843 DEBUG [RS:0;jenkins-hbase4:37859] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,843 DEBUG [RS:0;jenkins-hbase4:37859] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,843 DEBUG [RS:0;jenkins-hbase4:37859] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,843 DEBUG [RS:0;jenkins-hbase4:37859] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:40,843 DEBUG [RS:0;jenkins-hbase4:37859] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,843 DEBUG [RS:0;jenkins-hbase4:37859] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,843 DEBUG [RS:0;jenkins-hbase4:37859] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,843 DEBUG [RS:0;jenkins-hbase4:37859] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:40,845 INFO [RS:0;jenkins-hbase4:37859] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,845 INFO [RS:0;jenkins-hbase4:37859] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,845 INFO [RS:0;jenkins-hbase4:37859] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,855 INFO [RS:1;jenkins-hbase4:34947] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:40,855 INFO [RS:1;jenkins-hbase4:34947] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34947,1676502100571-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,860 INFO [RS:0;jenkins-hbase4:37859] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:40,860 INFO [RS:0;jenkins-hbase4:37859] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37859,1676502100548-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:40,866 INFO [RS:1;jenkins-hbase4:34947] regionserver.Replication(203): jenkins-hbase4.apache.org,34947,1676502100571 started 2023-02-15 23:01:40,866 INFO [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34947,1676502100571, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34947, sessionid=0x1005a37d3c30002 2023-02-15 23:01:40,866 DEBUG [RS:1;jenkins-hbase4:34947] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:40,866 DEBUG [RS:1;jenkins-hbase4:34947] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:40,866 DEBUG [RS:1;jenkins-hbase4:34947] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34947,1676502100571' 2023-02-15 23:01:40,866 DEBUG [RS:1;jenkins-hbase4:34947] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:40,866 DEBUG [RS:1;jenkins-hbase4:34947] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:40,867 DEBUG [RS:1;jenkins-hbase4:34947] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:40,867 DEBUG [RS:1;jenkins-hbase4:34947] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:40,867 DEBUG [RS:1;jenkins-hbase4:34947] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:40,867 DEBUG [RS:1;jenkins-hbase4:34947] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34947,1676502100571' 2023-02-15 23:01:40,867 DEBUG [RS:1;jenkins-hbase4:34947] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:40,867 DEBUG [RS:1;jenkins-hbase4:34947] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:40,867 DEBUG [RS:1;jenkins-hbase4:34947] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:40,867 INFO [RS:1;jenkins-hbase4:34947] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:40,867 INFO [RS:1;jenkins-hbase4:34947] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:40,873 INFO [RS:0;jenkins-hbase4:37859] regionserver.Replication(203): jenkins-hbase4.apache.org,37859,1676502100548 started 2023-02-15 23:01:40,873 INFO [RS:0;jenkins-hbase4:37859] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37859,1676502100548, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37859, sessionid=0x1005a37d3c30001 2023-02-15 23:01:40,873 DEBUG [RS:0;jenkins-hbase4:37859] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:40,873 DEBUG [RS:0;jenkins-hbase4:37859] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:40,873 DEBUG [RS:0;jenkins-hbase4:37859] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37859,1676502100548' 2023-02-15 23:01:40,873 DEBUG [RS:0;jenkins-hbase4:37859] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:40,874 DEBUG [RS:0;jenkins-hbase4:37859] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:40,874 DEBUG [RS:0;jenkins-hbase4:37859] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:40,874 DEBUG [RS:0;jenkins-hbase4:37859] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:40,874 DEBUG [RS:0;jenkins-hbase4:37859] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:40,874 DEBUG [RS:0;jenkins-hbase4:37859] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37859,1676502100548' 2023-02-15 23:01:40,874 DEBUG [RS:0;jenkins-hbase4:37859] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:40,874 DEBUG [RS:0;jenkins-hbase4:37859] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:40,874 DEBUG [RS:0;jenkins-hbase4:37859] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:40,874 INFO [RS:0;jenkins-hbase4:37859] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:40,874 INFO [RS:0;jenkins-hbase4:37859] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:40,899 DEBUG [jenkins-hbase4:35295] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 23:01:40,899 DEBUG [jenkins-hbase4:35295] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:40,901 DEBUG [jenkins-hbase4:35295] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:40,901 DEBUG [jenkins-hbase4:35295] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:40,901 DEBUG [jenkins-hbase4:35295] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:40,901 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34947,1676502100571, state=OPENING 2023-02-15 23:01:40,902 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 23:01:40,904 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:40,904 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:40,904 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34947,1676502100571}] 2023-02-15 23:01:41,058 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:41,059 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:41,060 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60692, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:41,064 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 23:01:41,065 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:41,066 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34947%2C1676502100571.meta, suffix=.meta, logDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/WALs/jenkins-hbase4.apache.org,34947,1676502100571, archiveDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/oldWALs, maxLogs=32 2023-02-15 23:01:41,084 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36811,DS-616b9f14-2e0e-4183-bb83-b09c1d2428ae,DISK] 2023-02-15 23:01:41,084 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46551,DS-0d9598b5-55b4-42ab-a7d0-0e0601cccdf0,DISK] 2023-02-15 23:01:41,086 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/WALs/jenkins-hbase4.apache.org,34947,1676502100571/jenkins-hbase4.apache.org%2C34947%2C1676502100571.meta.1676502101066.meta 2023-02-15 23:01:41,086 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36811,DS-616b9f14-2e0e-4183-bb83-b09c1d2428ae,DISK], DatanodeInfoWithStorage[127.0.0.1:46551,DS-0d9598b5-55b4-42ab-a7d0-0e0601cccdf0,DISK]] 2023-02-15 23:01:41,086 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:41,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 23:01:41,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 23:01:41,087 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 23:01:41,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 23:01:41,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:41,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 23:01:41,087 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 23:01:41,088 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:41,089 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/info 2023-02-15 23:01:41,089 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/info 2023-02-15 23:01:41,090 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:41,090 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:41,090 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:41,091 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:41,091 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:41,091 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:41,091 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:41,092 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:41,092 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/table 2023-02-15 23:01:41,092 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/table 2023-02-15 23:01:41,092 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:41,093 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:41,093 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740 2023-02-15 23:01:41,094 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740 2023-02-15 23:01:41,096 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:41,097 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:41,097 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65422546, jitterRate=-0.025128096342086792}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:41,097 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:41,098 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676502101058 2023-02-15 23:01:41,102 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 23:01:41,102 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 23:01:41,103 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34947,1676502100571, state=OPEN 2023-02-15 23:01:41,105 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 23:01:41,105 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:41,108 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 23:01:41,108 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34947,1676502100571 in 201 msec 2023-02-15 23:01:41,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 23:01:41,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 362 msec 2023-02-15 23:01:41,111 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 400 msec 2023-02-15 23:01:41,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676502101111, completionTime=-1 2023-02-15 23:01:41,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 23:01:41,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 23:01:41,113 DEBUG [hconnection-0x1cf81390-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:41,114 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60700, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:41,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 23:01:41,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676502161116 2023-02-15 23:01:41,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676502221116 2023-02-15 23:01:41,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-15 23:01:41,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35295,1676502100495-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:41,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35295,1676502100495-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:41,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35295,1676502100495-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:41,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35295, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:41,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:41,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 23:01:41,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:41,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 23:01:41,123 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 23:01:41,124 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:41,124 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:41,126 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/hbase/namespace/a9babbef6d2fbb53b0dfa26831e65ffd 2023-02-15 23:01:41,126 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/hbase/namespace/a9babbef6d2fbb53b0dfa26831e65ffd empty. 2023-02-15 23:01:41,126 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/hbase/namespace/a9babbef6d2fbb53b0dfa26831e65ffd 2023-02-15 23:01:41,126 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 23:01:41,138 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:41,140 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a9babbef6d2fbb53b0dfa26831e65ffd, NAME => 'hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp 2023-02-15 23:01:41,150 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:41,150 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a9babbef6d2fbb53b0dfa26831e65ffd, disabling compactions & flushes 2023-02-15 23:01:41,150 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. 2023-02-15 23:01:41,150 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. 2023-02-15 23:01:41,150 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. after waiting 0 ms 2023-02-15 23:01:41,150 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. 2023-02-15 23:01:41,150 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. 2023-02-15 23:01:41,150 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a9babbef6d2fbb53b0dfa26831e65ffd: 2023-02-15 23:01:41,152 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:41,152 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502101152"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502101152"}]},"ts":"1676502101152"} 2023-02-15 23:01:41,155 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 23:01:41,156 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:41,156 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502101156"}]},"ts":"1676502101156"} 2023-02-15 23:01:41,157 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 23:01:41,160 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:41,161 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:41,161 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:41,161 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:41,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a9babbef6d2fbb53b0dfa26831e65ffd, ASSIGN}] 2023-02-15 23:01:41,164 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a9babbef6d2fbb53b0dfa26831e65ffd, ASSIGN 2023-02-15 23:01:41,165 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a9babbef6d2fbb53b0dfa26831e65ffd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34947,1676502100571; forceNewPlan=false, retain=false 2023-02-15 23:01:41,315 INFO [jenkins-hbase4:35295] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 23:01:41,315 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a9babbef6d2fbb53b0dfa26831e65ffd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:41,315 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502101315"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502101315"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502101315"}]},"ts":"1676502101315"} 2023-02-15 23:01:41,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a9babbef6d2fbb53b0dfa26831e65ffd, server=jenkins-hbase4.apache.org,34947,1676502100571}] 2023-02-15 23:01:41,475 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. 2023-02-15 23:01:41,476 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34947%2C1676502100571, suffix=, logDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/WALs/jenkins-hbase4.apache.org,34947,1676502100571, archiveDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/oldWALs, maxLogs=32 2023-02-15 23:01:41,488 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36811,DS-616b9f14-2e0e-4183-bb83-b09c1d2428ae,DISK] 2023-02-15 23:01:41,488 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46551,DS-0d9598b5-55b4-42ab-a7d0-0e0601cccdf0,DISK] 2023-02-15 23:01:41,489 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/WALs/jenkins-hbase4.apache.org,34947,1676502100571/jenkins-hbase4.apache.org%2C34947%2C1676502100571.1676502101476 2023-02-15 23:01:41,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36811,DS-616b9f14-2e0e-4183-bb83-b09c1d2428ae,DISK], DatanodeInfoWithStorage[127.0.0.1:46551,DS-0d9598b5-55b4-42ab-a7d0-0e0601cccdf0,DISK]] 2023-02-15 23:01:41,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a9babbef6d2fbb53b0dfa26831e65ffd, NAME => 'hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:41,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a9babbef6d2fbb53b0dfa26831e65ffd 2023-02-15 23:01:41,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:41,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a9babbef6d2fbb53b0dfa26831e65ffd 2023-02-15 23:01:41,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a9babbef6d2fbb53b0dfa26831e65ffd 2023-02-15 23:01:41,491 INFO [StoreOpener-a9babbef6d2fbb53b0dfa26831e65ffd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a9babbef6d2fbb53b0dfa26831e65ffd 2023-02-15 23:01:41,492 DEBUG [StoreOpener-a9babbef6d2fbb53b0dfa26831e65ffd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/namespace/a9babbef6d2fbb53b0dfa26831e65ffd/info 2023-02-15 23:01:41,492 DEBUG [StoreOpener-a9babbef6d2fbb53b0dfa26831e65ffd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/namespace/a9babbef6d2fbb53b0dfa26831e65ffd/info 2023-02-15 23:01:41,492 INFO [StoreOpener-a9babbef6d2fbb53b0dfa26831e65ffd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9babbef6d2fbb53b0dfa26831e65ffd columnFamilyName info 2023-02-15 23:01:41,493 INFO [StoreOpener-a9babbef6d2fbb53b0dfa26831e65ffd-1] regionserver.HStore(310): Store=a9babbef6d2fbb53b0dfa26831e65ffd/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:41,493 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/namespace/a9babbef6d2fbb53b0dfa26831e65ffd 2023-02-15 23:01:41,493 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/namespace/a9babbef6d2fbb53b0dfa26831e65ffd 2023-02-15 23:01:41,495 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a9babbef6d2fbb53b0dfa26831e65ffd 2023-02-15 23:01:41,500 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/namespace/a9babbef6d2fbb53b0dfa26831e65ffd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:41,501 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a9babbef6d2fbb53b0dfa26831e65ffd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65427567, jitterRate=-0.025053277611732483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:41,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a9babbef6d2fbb53b0dfa26831e65ffd: 2023-02-15 23:01:41,501 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd., pid=6, masterSystemTime=1676502101472 2023-02-15 23:01:41,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. 2023-02-15 23:01:41,503 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. 2023-02-15 23:01:41,503 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a9babbef6d2fbb53b0dfa26831e65ffd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:41,504 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502101503"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502101503"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502101503"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502101503"}]},"ts":"1676502101503"} 2023-02-15 23:01:41,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 23:01:41,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a9babbef6d2fbb53b0dfa26831e65ffd, server=jenkins-hbase4.apache.org,34947,1676502100571 in 188 msec 2023-02-15 23:01:41,507 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 23:01:41,507 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a9babbef6d2fbb53b0dfa26831e65ffd, ASSIGN in 345 msec 2023-02-15 23:01:41,507 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:41,508 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502101508"}]},"ts":"1676502101508"} 2023-02-15 23:01:41,509 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 23:01:41,510 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:41,511 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 388 msec 2023-02-15 23:01:41,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 23:01:41,525 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:41,525 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:41,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 23:01:41,534 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:41,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-15 23:01:41,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 23:01:41,554 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:41,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-15 23:01:41,563 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 23:01:41,565 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 23:01:41,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.961sec 2023-02-15 23:01:41,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 23:01:41,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 23:01:41,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 23:01:41,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35295,1676502100495-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 23:01:41,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35295,1676502100495-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 23:01:41,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 23:01:41,594 DEBUG [Listener at localhost/35227] zookeeper.ReadOnlyZKClient(139): Connect 0x1becada7 to 127.0.0.1:50939 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:41,604 DEBUG [Listener at localhost/35227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@782477fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:41,605 DEBUG [hconnection-0x3a979228-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:41,607 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60702, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:41,609 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35295,1676502100495 2023-02-15 23:01:41,609 DEBUG [Listener at localhost/35227] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 23:01:41,611 DEBUG [Listener at localhost/35227] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 23:01:41,613 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39680, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 23:01:41,614 INFO [Listener at localhost/35227] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-15 23:01:41,614 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-15 23:01:41,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 23:01:41,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:39680 deadline: 1676502161614, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-15 23:01:41,615 INFO [Listener at localhost/35227] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-15 23:01:41,617 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:41,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 23:01:41,619 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:41,619 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-15 23:01:41,620 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:41,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:41,621 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:41,621 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac empty. 2023-02-15 23:01:41,621 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:41,622 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-15 23:01:41,634 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:41,635 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => bb4abddaa7ca7ce27795d9fde1f3f1ac, NAME => 'testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp 2023-02-15 23:01:41,641 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:41,641 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing bb4abddaa7ca7ce27795d9fde1f3f1ac, disabling compactions & flushes 2023-02-15 23:01:41,641 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:41,641 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:41,641 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. after waiting 0 ms 2023-02-15 23:01:41,641 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:41,641 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:41,641 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for bb4abddaa7ca7ce27795d9fde1f3f1ac: 2023-02-15 23:01:41,642 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:41,643 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676502101643"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502101643"}]},"ts":"1676502101643"} 2023-02-15 23:01:41,644 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 23:01:41,645 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:41,645 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502101645"}]},"ts":"1676502101645"} 2023-02-15 23:01:41,646 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-15 23:01:41,650 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:41,651 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:41,651 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:41,651 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:41,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bb4abddaa7ca7ce27795d9fde1f3f1ac, ASSIGN}] 2023-02-15 23:01:41,653 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bb4abddaa7ca7ce27795d9fde1f3f1ac, ASSIGN 2023-02-15 23:01:41,653 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bb4abddaa7ca7ce27795d9fde1f3f1ac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37859,1676502100548; forceNewPlan=false, retain=false 2023-02-15 23:01:41,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:41,803 INFO [jenkins-hbase4:35295] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 23:01:41,804 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bb4abddaa7ca7ce27795d9fde1f3f1ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:41,804 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676502101804"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502101804"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502101804"}]},"ts":"1676502101804"} 2023-02-15 23:01:41,806 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure bb4abddaa7ca7ce27795d9fde1f3f1ac, server=jenkins-hbase4.apache.org,37859,1676502100548}] 2023-02-15 23:01:41,876 INFO [RS:0;jenkins-hbase4:37859] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37859%2C1676502100548, suffix=, logDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/WALs/jenkins-hbase4.apache.org,37859,1676502100548, archiveDir=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/oldWALs, maxLogs=32 2023-02-15 23:01:41,890 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36811,DS-616b9f14-2e0e-4183-bb83-b09c1d2428ae,DISK] 2023-02-15 23:01:41,890 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46551,DS-0d9598b5-55b4-42ab-a7d0-0e0601cccdf0,DISK] 2023-02-15 23:01:41,892 INFO [RS:0;jenkins-hbase4:37859] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/WALs/jenkins-hbase4.apache.org,37859,1676502100548/jenkins-hbase4.apache.org%2C37859%2C1676502100548.1676502101876 2023-02-15 23:01:41,892 DEBUG [RS:0;jenkins-hbase4:37859] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36811,DS-616b9f14-2e0e-4183-bb83-b09c1d2428ae,DISK], DatanodeInfoWithStorage[127.0.0.1:46551,DS-0d9598b5-55b4-42ab-a7d0-0e0601cccdf0,DISK]] 2023-02-15 23:01:41,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:41,958 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:41,958 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:41,960 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60580, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:41,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:41,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bb4abddaa7ca7ce27795d9fde1f3f1ac, NAME => 'testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:41,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:41,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:41,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:41,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:41,964 INFO [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:41,965 DEBUG [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1 2023-02-15 23:01:41,965 DEBUG [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1 2023-02-15 23:01:41,965 INFO [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4abddaa7ca7ce27795d9fde1f3f1ac columnFamilyName f1 2023-02-15 23:01:41,966 INFO [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] regionserver.HStore(310): Store=bb4abddaa7ca7ce27795d9fde1f3f1ac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:41,966 INFO [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:41,967 DEBUG [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2 2023-02-15 23:01:41,967 DEBUG [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2 2023-02-15 23:01:41,967 INFO [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4abddaa7ca7ce27795d9fde1f3f1ac columnFamilyName f2 2023-02-15 23:01:41,967 INFO [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] regionserver.HStore(310): Store=bb4abddaa7ca7ce27795d9fde1f3f1ac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:41,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:41,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:41,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:41,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:41,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:41,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bb4abddaa7ca7ce27795d9fde1f3f1ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72501193, jitterRate=0.08035196363925934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:41,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bb4abddaa7ca7ce27795d9fde1f3f1ac: 2023-02-15 23:01:41,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac., pid=12, masterSystemTime=1676502101958 2023-02-15 23:01:41,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:41,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:41,979 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bb4abddaa7ca7ce27795d9fde1f3f1ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:41,979 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676502101979"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502101979"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502101979"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502101979"}]},"ts":"1676502101979"} 2023-02-15 23:01:41,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 23:01:41,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure bb4abddaa7ca7ce27795d9fde1f3f1ac, server=jenkins-hbase4.apache.org,37859,1676502100548 in 174 msec 2023-02-15 23:01:41,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 23:01:41,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bb4abddaa7ca7ce27795d9fde1f3f1ac, ASSIGN in 330 msec 2023-02-15 23:01:41,983 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:41,983 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502101983"}]},"ts":"1676502101983"} 2023-02-15 23:01:41,984 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-15 23:01:41,986 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:41,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 370 msec 2023-02-15 23:01:42,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:42,224 INFO [Listener at localhost/35227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-15 23:01:42,225 DEBUG [Listener at localhost/35227] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-15 23:01:42,225 INFO [Listener at localhost/35227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:42,227 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-15 23:01:42,227 INFO [Listener at localhost/35227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:42,227 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-15 23:01:42,227 INFO [Listener at localhost/35227] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 23:01:42,240 DEBUG [hconnection-0x3a979228-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:42,253 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60586, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:42,259 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:42,354 INFO [Listener at localhost/35227] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 23:01:42,354 INFO [Listener at localhost/35227] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 23:01:42,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-15 23:01:42,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676502102355 (current time:1676502102355). 2023-02-15 23:01:42,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 23:01:42,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] zookeeper.ReadOnlyZKClient(139): Connect 0x646afdcc to 127.0.0.1:50939 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:42,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d039785, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:42,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:42,360 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60716, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:42,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x646afdcc to 127.0.0.1:50939 2023-02-15 23:01:42,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:42,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 23:01:42,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-15 23:01:42,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-15 23:01:42,365 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-15 23:01:42,365 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676502702365 2023-02-15 23:01:42,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-15 23:01:42,365 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,367 DEBUG [Listener at localhost/35227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:42,367 DEBUG [Listener at localhost/35227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 23:01:42,367 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-15 23:01:42,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-15 23:01:42,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-15 23:01:42,369 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-15 23:01:42,369 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676502702369 2023-02-15 23:01:42,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,376 INFO [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-15 23:01:42,376 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:42,377 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-15 23:01:42,377 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-15 23:01:42,377 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,377 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,378 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:42,378 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:42,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:42,378 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:42,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:42,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:42,378 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,378 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:42,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-15 23:01:42,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,379 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-15 23:01:42,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-15 23:01:42,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,379 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-15 23:01:42,379 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,379 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,380 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-15 23:01:42,380 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-15 23:01:42,380 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:42,380 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:42,380 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 23:01:42,381 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 23:01:42,381 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 23:01:42,381 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 23:01:42,381 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37859,1676502100548' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 23:01:42,381 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34947,1676502100571' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 23:01:42,382 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,382 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:42,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:42,382 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,382 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,383 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:42,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:42,383 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,383 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:42,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:42,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:42,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37859,1676502100548' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-15 23:01:42,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7402059d[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:42,384 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-15 23:01:42,384 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,385 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,385 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,385 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 23:01:42,385 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 23:01:42,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,385 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34947,1676502100571' in zk 2023-02-15 23:01:42,385 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 23:01:42,385 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,385 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:42,386 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 23:01:42,386 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 23:01:42,386 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:42,386 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. started... 2023-02-15 23:01:42,386 INFO [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bb4abddaa7ca7ce27795d9fde1f3f1ac 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 23:01:42,388 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 23:01:42,388 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:42,388 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 23:01:42,399 INFO [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/.tmp/f1/dd367b0aedce456b8d7c314307a67171 2023-02-15 23:01:42,419 INFO [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/.tmp/f2/2e675c7c9f1b41f2aeab4820ca43568a 2023-02-15 23:01:42,423 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/.tmp/f1/dd367b0aedce456b8d7c314307a67171 as hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1/dd367b0aedce456b8d7c314307a67171 2023-02-15 23:01:42,426 INFO [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1/dd367b0aedce456b8d7c314307a67171, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 23:01:42,427 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/.tmp/f2/2e675c7c9f1b41f2aeab4820ca43568a as hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2/2e675c7c9f1b41f2aeab4820ca43568a 2023-02-15 23:01:42,430 INFO [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2/2e675c7c9f1b41f2aeab4820ca43568a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 23:01:42,431 INFO [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for bb4abddaa7ca7ce27795d9fde1f3f1ac in 45ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:42,431 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-15 23:01:42,432 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bb4abddaa7ca7ce27795d9fde1f3f1ac: 2023-02-15 23:01:42,432 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,432 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:42,432 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1/dd367b0aedce456b8d7c314307a67171] hfiles 2023-02-15 23:01:42,432 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1/dd367b0aedce456b8d7c314307a67171 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,432 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2/2e675c7c9f1b41f2aeab4820ca43568a] hfiles 2023-02-15 23:01:42,432 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2/2e675c7c9f1b41f2aeab4820ca43568a for snapshot=testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,437 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. completed. 2023-02-15 23:01:42,437 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:42,437 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 23:01:42,437 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 23:01:42,437 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,437 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 23:01:42,437 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37859,1676502100548' in zk 2023-02-15 23:01:42,438 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,440 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 23:01:42,440 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:42,440 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 23:01:42,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:42,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,37859,1676502100548': 2023-02-15 23:01:42,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37859,1676502100548' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-15 23:01:42,441 INFO [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-15 23:01:42,441 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:42,441 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:42,441 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,441 INFO [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 23:01:42,443 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,443 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,443 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,443 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,443 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:42,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:42,443 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:42,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,444 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:42,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,445 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:42,445 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,451 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,451 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,451 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:42,451 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:42,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:42,451 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,451 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:42,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,451 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:42,451 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:42,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:42,451 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:42,451 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,452 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,452 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,452 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,452 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:42,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:42,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,452 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:42,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:42,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,467 DEBUG [Listener at localhost/35227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:42,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-15 23:01:42,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 23:01:42,469 DEBUG [Listener at localhost/35227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 23:01:42,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-15 23:01:42,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,480 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676502102365Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676502102451 (+86 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676502102451Writing data manifest for testWithMockedMapReduceSingleRegion at 1676502102454 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676502102459 (+5 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676502102479 (+20 ms) 2023-02-15 23:01:42,482 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-15 23:01:42,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 116 msec 2023-02-15 23:01:42,669 DEBUG [Listener at localhost/35227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:42,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-15 23:01:42,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 23:01:42,671 INFO [Listener at localhost/35227] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 23:01:42,674 INFO [Listener at localhost/35227] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 23:01:42,679 INFO [Listener at localhost/35227] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 23:01:42,707 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:42,786 INFO [Listener at localhost/35227] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 23:01:42,791 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 23:01:42,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,793 INFO [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-15 23:01:42,793 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:42,794 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-15 23:01:42,794 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-15 23:01:42,794 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,794 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,796 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:42,796 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:42,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:42,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:42,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:42,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:42,796 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,796 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,796 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:42,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:42,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:42,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,797 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,797 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,797 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-15 23:01:42,797 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:42,798 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-15 23:01:42,798 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:42,798 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 23:01:42,799 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 23:01:42,799 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 23:01:42,799 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34947,1676502100571' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 23:01:42,799 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 23:01:42,799 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 23:01:42,799 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:42,799 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. started... 2023-02-15 23:01:42,799 INFO [rs(jenkins-hbase4.apache.org,37859,1676502100548)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bb4abddaa7ca7ce27795d9fde1f3f1ac 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 23:01:42,801 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,801 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,801 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:42,814 INFO [rs(jenkins-hbase4.apache.org,37859,1676502100548)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/.tmp/f1/72e89f8670ec40daa6b126b085c2a5f9 2023-02-15 23:01:42,832 INFO [rs(jenkins-hbase4.apache.org,37859,1676502100548)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/.tmp/f2/e1da3d3caa9949d6a54403a0fd629670 2023-02-15 23:01:42,836 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/.tmp/f1/72e89f8670ec40daa6b126b085c2a5f9 as hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1/72e89f8670ec40daa6b126b085c2a5f9 2023-02-15 23:01:42,839 INFO [rs(jenkins-hbase4.apache.org,37859,1676502100548)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1/72e89f8670ec40daa6b126b085c2a5f9, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 23:01:42,840 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/.tmp/f2/e1da3d3caa9949d6a54403a0fd629670 as hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2/e1da3d3caa9949d6a54403a0fd629670 2023-02-15 23:01:42,843 INFO [rs(jenkins-hbase4.apache.org,37859,1676502100548)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2/e1da3d3caa9949d6a54403a0fd629670, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 23:01:42,844 INFO [rs(jenkins-hbase4.apache.org,37859,1676502100548)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for bb4abddaa7ca7ce27795d9fde1f3f1ac in 45ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:42,845 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bb4abddaa7ca7ce27795d9fde1f3f1ac: 2023-02-15 23:01:42,845 DEBUG [rs(jenkins-hbase4.apache.org,37859,1676502100548)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:42,845 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 23:01:42,845 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 23:01:42,845 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,845 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 23:01:42,845 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37859,1676502100548' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 23:01:42,847 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,847 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:42,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:42,847 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:42,847 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:42,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:42,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:42,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37859,1676502100548' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-15 23:01:42,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@703d8fc5[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:42,849 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-15 23:01:42,849 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,851 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,851 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,851 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 23:01:42,851 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 23:01:42,851 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 23:01:42,851 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 23:01:42,851 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,851 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:42,851 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37859,1676502100548' in zk 2023-02-15 23:01:42,851 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34947,1676502100571' in zk 2023-02-15 23:01:42,852 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,852 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 23:01:42,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:42,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:42,852 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:42,852 DEBUG [member: 'jenkins-hbase4.apache.org,37859,1676502100548' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 23:01:42,853 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 23:01:42,853 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:42,853 DEBUG [member: 'jenkins-hbase4.apache.org,34947,1676502100571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 23:01:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,37859,1676502100548': 2023-02-15 23:01:42,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37859,1676502100548' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-15 23:01:42,855 INFO [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-15 23:01:42,855 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:42,855 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:42,855 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,855 INFO [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 23:01:42,856 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,856 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:42,857 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:42,856 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,857 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:42,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:42,857 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,858 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:42,859 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,859 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,862 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,862 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:42,862 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:42,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:42,862 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-15 23:01:42,862 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 23:01:42,862 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,863 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,862 DEBUG [(jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:42,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:42,862 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:42,862 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:42,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:42,863 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,863 DEBUG [Listener at localhost/35227] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:42,863 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:42,863 DEBUG [Listener at localhost/35227] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 23:01:42,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:42,863 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,863 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:42,863 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,863 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,963 DEBUG [Listener at localhost/35227] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 23:01:42,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 23:01:42,968 INFO [Listener at localhost/35227] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676502102355 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:42,968 DEBUG [Listener at localhost/35227] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36163/user/jenkins/test-data/8a763974-f24f-291c-cafd-59086d176e75/testWithMockedMapReduceSingleRegion/c1d16890-ba7a-4877-b76d-46c7023cbbca/data/default/testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,969 INFO [Listener at localhost/35227] snapshot.RestoreSnapshotHelper(239): region to add: bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:42,969 INFO [Listener at localhost/35227] snapshot.RestoreSnapshotHelper(585): clone region=bb4abddaa7ca7ce27795d9fde1f3f1ac as bb4abddaa7ca7ce27795d9fde1f3f1ac in snapshot testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,969 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => bb4abddaa7ca7ce27795d9fde1f3f1ac, NAME => 'testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36163/user/jenkins/test-data/8a763974-f24f-291c-cafd-59086d176e75/testWithMockedMapReduceSingleRegion/c1d16890-ba7a-4877-b76d-46c7023cbbca 2023-02-15 23:01:42,975 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:42,975 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dd367b0aedce456b8d7c314307a67171 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,977 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2e675c7c9f1b41f2aeab4820ca43568a from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-15 23:01:42,978 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing bb4abddaa7ca7ce27795d9fde1f3f1ac, disabling compactions & flushes 2023-02-15 23:01:42,979 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:42,979 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:42,979 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. after waiting 0 ms 2023-02-15 23:01:42,979 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:42,979 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:42,979 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for bb4abddaa7ca7ce27795d9fde1f3f1ac: 2023-02-15 23:01:42,979 INFO [Listener at localhost/35227] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676502102355 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:42,979 DEBUG [Listener at localhost/35227] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36163/user/jenkins/test-data/8a763974-f24f-291c-cafd-59086d176e75/testWithMockedMapReduceSingleRegion/c1d16890-ba7a-4877-b76d-46c7023cbbca 2023-02-15 23:01:42,979 DEBUG [Listener at localhost/35227] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36163/user/jenkins/test-data/8a763974-f24f-291c-cafd-59086d176e75/testWithMockedMapReduceSingleRegion/c1d16890-ba7a-4877-b76d-46c7023cbbca 2023-02-15 23:01:42,979 DEBUG [Listener at localhost/35227] util.CommonFSUtils(699): |-data/ 2023-02-15 23:01:42,980 DEBUG [Listener at localhost/35227] util.CommonFSUtils(699): |----default/ 2023-02-15 23:01:42,980 DEBUG [Listener at localhost/35227] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-15 23:01:42,980 DEBUG [Listener at localhost/35227] util.CommonFSUtils(699): |----------bb4abddaa7ca7ce27795d9fde1f3f1ac/ 2023-02-15 23:01:42,981 DEBUG [Listener at localhost/35227] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:42,981 DEBUG [Listener at localhost/35227] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:42,981 DEBUG [Listener at localhost/35227] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=bb4abddaa7ca7ce27795d9fde1f3f1ac-dd367b0aedce456b8d7c314307a67171 2023-02-15 23:01:42,981 DEBUG [Listener at localhost/35227] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:42,981 DEBUG [Listener at localhost/35227] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=bb4abddaa7ca7ce27795d9fde1f3f1ac-2e675c7c9f1b41f2aeab4820ca43568a 2023-02-15 23:01:42,984 INFO [Listener at localhost/35227] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 23:01:42,986 DEBUG [Listener at localhost/35227] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:42,987 INFO [Listener at localhost/35227] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:42,987 DEBUG [Listener at localhost/35227] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:42,989 INFO [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:42,990 DEBUG [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/8a763974-f24f-291c-cafd-59086d176e75/testWithMockedMapReduceSingleRegion/c1d16890-ba7a-4877-b76d-46c7023cbbca/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1 2023-02-15 23:01:42,990 INFO [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4abddaa7ca7ce27795d9fde1f3f1ac columnFamilyName f1 2023-02-15 23:01:42,993 DEBUG [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] regionserver.HStore(539): loaded hdfs://localhost:36163/user/jenkins/test-data/8a763974-f24f-291c-cafd-59086d176e75/testWithMockedMapReduceSingleRegion/c1d16890-ba7a-4877-b76d-46c7023cbbca/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1/testWithMockedMapReduceSingleRegion=bb4abddaa7ca7ce27795d9fde1f3f1ac-dd367b0aedce456b8d7c314307a67171 2023-02-15 23:01:42,993 INFO [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] regionserver.HStore(310): Store=bb4abddaa7ca7ce27795d9fde1f3f1ac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:42,993 INFO [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:42,994 DEBUG [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36163/user/jenkins/test-data/8a763974-f24f-291c-cafd-59086d176e75/testWithMockedMapReduceSingleRegion/c1d16890-ba7a-4877-b76d-46c7023cbbca/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2 2023-02-15 23:01:42,994 INFO [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb4abddaa7ca7ce27795d9fde1f3f1ac columnFamilyName f2 2023-02-15 23:01:42,997 DEBUG [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] regionserver.HStore(539): loaded hdfs://localhost:36163/user/jenkins/test-data/8a763974-f24f-291c-cafd-59086d176e75/testWithMockedMapReduceSingleRegion/c1d16890-ba7a-4877-b76d-46c7023cbbca/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2/testWithMockedMapReduceSingleRegion=bb4abddaa7ca7ce27795d9fde1f3f1ac-2e675c7c9f1b41f2aeab4820ca43568a 2023-02-15 23:01:42,998 INFO [StoreOpener-bb4abddaa7ca7ce27795d9fde1f3f1ac-1] regionserver.HStore(310): Store=bb4abddaa7ca7ce27795d9fde1f3f1ac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:42,998 DEBUG [Listener at localhost/35227] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:42,998 INFO [Listener at localhost/35227] regionserver.HRegion(1071): Opened bb4abddaa7ca7ce27795d9fde1f3f1ac; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63157032, jitterRate=-0.05888688564300537}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:42,998 DEBUG [Listener at localhost/35227] regionserver.HRegion(964): Region open journal for bb4abddaa7ca7ce27795d9fde1f3f1ac: 2023-02-15 23:01:43,044 DEBUG [Listener at localhost/35227] regionserver.HRegion(1603): Closing bb4abddaa7ca7ce27795d9fde1f3f1ac, disabling compactions & flushes 2023-02-15 23:01:43,044 INFO [Listener at localhost/35227] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:43,044 DEBUG [Listener at localhost/35227] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:43,044 DEBUG [Listener at localhost/35227] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. after waiting 0 ms 2023-02-15 23:01:43,044 DEBUG [Listener at localhost/35227] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:43,045 INFO [Listener at localhost/35227] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:43,045 DEBUG [Listener at localhost/35227] regionserver.HRegion(1557): Region close journal for bb4abddaa7ca7ce27795d9fde1f3f1ac: 2023-02-15 23:01:43,049 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-15 23:01:43,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-15 23:01:43,053 INFO [Listener at localhost/35227] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-15 23:01:43,053 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-15 23:01:43,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 23:01:43,056 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502103056"}]},"ts":"1676502103056"} 2023-02-15 23:01:43,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 23:01:43,058 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-15 23:01:43,060 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-15 23:01:43,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bb4abddaa7ca7ce27795d9fde1f3f1ac, UNASSIGN}] 2023-02-15 23:01:43,062 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bb4abddaa7ca7ce27795d9fde1f3f1ac, UNASSIGN 2023-02-15 23:01:43,062 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bb4abddaa7ca7ce27795d9fde1f3f1ac, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:43,062 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676502103062"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502103062"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502103062"}]},"ts":"1676502103062"} 2023-02-15 23:01:43,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure bb4abddaa7ca7ce27795d9fde1f3f1ac, server=jenkins-hbase4.apache.org,37859,1676502100548}] 2023-02-15 23:01:43,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 23:01:43,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:43,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bb4abddaa7ca7ce27795d9fde1f3f1ac, disabling compactions & flushes 2023-02-15 23:01:43,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:43,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:43,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. after waiting 0 ms 2023-02-15 23:01:43,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:43,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:43,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac. 2023-02-15 23:01:43,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bb4abddaa7ca7ce27795d9fde1f3f1ac: 2023-02-15 23:01:43,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:43,222 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bb4abddaa7ca7ce27795d9fde1f3f1ac, regionState=CLOSED 2023-02-15 23:01:43,222 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676502103222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502103222"}]},"ts":"1676502103222"} 2023-02-15 23:01:43,224 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 23:01:43,224 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure bb4abddaa7ca7ce27795d9fde1f3f1ac, server=jenkins-hbase4.apache.org,37859,1676502100548 in 160 msec 2023-02-15 23:01:43,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 23:01:43,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bb4abddaa7ca7ce27795d9fde1f3f1ac, UNASSIGN in 164 msec 2023-02-15 23:01:43,226 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502103226"}]},"ts":"1676502103226"} 2023-02-15 23:01:43,227 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-15 23:01:43,228 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-15 23:01:43,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 176 msec 2023-02-15 23:01:43,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 23:01:43,360 INFO [Listener at localhost/35227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-15 23:01:43,360 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-15 23:01:43,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 23:01:43,362 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 23:01:43,363 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 23:01:43,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 23:01:43,366 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:43,368 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1, FileablePath, hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2, FileablePath, hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/recovered.edits] 2023-02-15 23:01:43,371 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1/72e89f8670ec40daa6b126b085c2a5f9 to hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/archive/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1/72e89f8670ec40daa6b126b085c2a5f9 2023-02-15 23:01:43,372 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1/dd367b0aedce456b8d7c314307a67171 to hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/archive/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f1/dd367b0aedce456b8d7c314307a67171 2023-02-15 23:01:43,374 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2/2e675c7c9f1b41f2aeab4820ca43568a to hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/archive/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2/2e675c7c9f1b41f2aeab4820ca43568a 2023-02-15 23:01:43,376 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2/e1da3d3caa9949d6a54403a0fd629670 to hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/archive/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/f2/e1da3d3caa9949d6a54403a0fd629670 2023-02-15 23:01:43,378 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/recovered.edits/12.seqid to hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/archive/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac/recovered.edits/12.seqid 2023-02-15 23:01:43,379 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/.tmp/data/default/testWithMockedMapReduceSingleRegion/bb4abddaa7ca7ce27795d9fde1f3f1ac 2023-02-15 23:01:43,379 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-15 23:01:43,380 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 23:01:43,382 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-15 23:01:43,383 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-15 23:01:43,384 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 23:01:43,384 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-15 23:01:43,384 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502103384"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:43,385 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 23:01:43,385 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bb4abddaa7ca7ce27795d9fde1f3f1ac, NAME => 'testWithMockedMapReduceSingleRegion,,1676502101617.bb4abddaa7ca7ce27795d9fde1f3f1ac.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 23:01:43,385 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-15 23:01:43,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676502103385"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:43,387 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-15 23:01:43,389 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 23:01:43,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 29 msec 2023-02-15 23:01:43,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35295] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 23:01:43,465 INFO [Listener at localhost/35227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-15 23:01:43,465 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 23:01:43,465 INFO [Listener at localhost/35227] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 23:01:43,465 DEBUG [Listener at localhost/35227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1becada7 to 127.0.0.1:50939 2023-02-15 23:01:43,466 DEBUG [Listener at localhost/35227] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:43,466 DEBUG [Listener at localhost/35227] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 23:01:43,466 DEBUG [Listener at localhost/35227] util.JVMClusterUtil(257): Found active master hash=743772391, stopped=false 2023-02-15 23:01:43,466 INFO [Listener at localhost/35227] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35295,1676502100495 2023-02-15 23:01:43,468 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:43,468 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:43,468 INFO [Listener at localhost/35227] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 23:01:43,468 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:43,469 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:43,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:43,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:43,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:43,470 DEBUG [Listener at localhost/35227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e19f1d2 to 127.0.0.1:50939 2023-02-15 23:01:43,470 DEBUG [Listener at localhost/35227] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:43,470 INFO [Listener at localhost/35227] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37859,1676502100548' ***** 2023-02-15 23:01:43,470 INFO [Listener at localhost/35227] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:43,470 INFO [Listener at localhost/35227] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34947,1676502100571' ***** 2023-02-15 23:01:43,470 INFO [Listener at localhost/35227] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:43,470 INFO [RS:0;jenkins-hbase4:37859] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:43,470 INFO [RS:1;jenkins-hbase4:34947] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:43,471 INFO [RS:0;jenkins-hbase4:37859] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:43,471 INFO [RS:1;jenkins-hbase4:34947] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:43,471 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:43,471 INFO [RS:1;jenkins-hbase4:34947] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:43,471 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:43,471 INFO [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(3304): Received CLOSE for a9babbef6d2fbb53b0dfa26831e65ffd 2023-02-15 23:01:43,471 INFO [RS:0;jenkins-hbase4:37859] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:43,472 INFO [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:43,472 INFO [RS:0;jenkins-hbase4:37859] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:43,472 DEBUG [RS:1;jenkins-hbase4:34947] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58bf2dfe to 127.0.0.1:50939 2023-02-15 23:01:43,472 DEBUG [RS:0;jenkins-hbase4:37859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f1ad076 to 127.0.0.1:50939 2023-02-15 23:01:43,472 DEBUG [RS:1;jenkins-hbase4:34947] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:43,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a9babbef6d2fbb53b0dfa26831e65ffd, disabling compactions & flushes 2023-02-15 23:01:43,472 INFO [RS:1;jenkins-hbase4:34947] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:43,472 DEBUG [RS:0;jenkins-hbase4:37859] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:43,473 INFO [RS:1;jenkins-hbase4:34947] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:43,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. 2023-02-15 23:01:43,473 INFO [RS:1;jenkins-hbase4:34947] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:43,473 INFO [RS:0;jenkins-hbase4:37859] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37859,1676502100548; all regions closed. 2023-02-15 23:01:43,473 INFO [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 23:01:43,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. 2023-02-15 23:01:43,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. after waiting 0 ms 2023-02-15 23:01:43,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. 2023-02-15 23:01:43,473 INFO [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-15 23:01:43,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing a9babbef6d2fbb53b0dfa26831e65ffd 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 23:01:43,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:43,473 DEBUG [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(1479): Online Regions={a9babbef6d2fbb53b0dfa26831e65ffd=hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd., 1588230740=hbase:meta,,1.1588230740} 2023-02-15 23:01:43,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:43,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:43,473 DEBUG [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(1505): Waiting on 1588230740, a9babbef6d2fbb53b0dfa26831e65ffd 2023-02-15 23:01:43,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:43,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:43,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-15 23:01:43,476 DEBUG [RS:0;jenkins-hbase4:37859] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/oldWALs 2023-02-15 23:01:43,477 INFO [RS:0;jenkins-hbase4:37859] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37859%2C1676502100548:(num 1676502101876) 2023-02-15 23:01:43,477 DEBUG [RS:0;jenkins-hbase4:37859] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:43,477 INFO [RS:0;jenkins-hbase4:37859] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:43,477 INFO [RS:0;jenkins-hbase4:37859] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:43,477 INFO [RS:0;jenkins-hbase4:37859] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:43,477 INFO [RS:0;jenkins-hbase4:37859] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:43,477 INFO [RS:0;jenkins-hbase4:37859] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:43,477 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:43,478 INFO [RS:0;jenkins-hbase4:37859] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37859 2023-02-15 23:01:43,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/.tmp/info/08f3c0d614aa4ab6af668f0b5717295a 2023-02-15 23:01:43,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/namespace/a9babbef6d2fbb53b0dfa26831e65ffd/.tmp/info/b4d54faf33244e318f9b87f622a85231 2023-02-15 23:01:43,489 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08f3c0d614aa4ab6af668f0b5717295a 2023-02-15 23:01:43,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/namespace/a9babbef6d2fbb53b0dfa26831e65ffd/.tmp/info/b4d54faf33244e318f9b87f622a85231 as hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/namespace/a9babbef6d2fbb53b0dfa26831e65ffd/info/b4d54faf33244e318f9b87f622a85231 2023-02-15 23:01:43,496 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/.tmp/rep_barrier/8e4dbd5cf28d493b858deb9c9fc59266 2023-02-15 23:01:43,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/namespace/a9babbef6d2fbb53b0dfa26831e65ffd/info/b4d54faf33244e318f9b87f622a85231, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 23:01:43,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a9babbef6d2fbb53b0dfa26831e65ffd in 25ms, sequenceid=6, compaction requested=false 2023-02-15 23:01:43,500 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e4dbd5cf28d493b858deb9c9fc59266 2023-02-15 23:01:43,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/namespace/a9babbef6d2fbb53b0dfa26831e65ffd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 23:01:43,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. 2023-02-15 23:01:43,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a9babbef6d2fbb53b0dfa26831e65ffd: 2023-02-15 23:01:43,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676502101122.a9babbef6d2fbb53b0dfa26831e65ffd. 2023-02-15 23:01:43,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/.tmp/table/6d4a9302f18d4f428b8c2fb25129d938 2023-02-15 23:01:43,510 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d4a9302f18d4f428b8c2fb25129d938 2023-02-15 23:01:43,510 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/.tmp/info/08f3c0d614aa4ab6af668f0b5717295a as hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/info/08f3c0d614aa4ab6af668f0b5717295a 2023-02-15 23:01:43,515 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08f3c0d614aa4ab6af668f0b5717295a 2023-02-15 23:01:43,516 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/info/08f3c0d614aa4ab6af668f0b5717295a, entries=12, sequenceid=21, filesize=6.3 K 2023-02-15 23:01:43,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/.tmp/rep_barrier/8e4dbd5cf28d493b858deb9c9fc59266 as hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/rep_barrier/8e4dbd5cf28d493b858deb9c9fc59266 2023-02-15 23:01:43,519 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e4dbd5cf28d493b858deb9c9fc59266 2023-02-15 23:01:43,520 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/rep_barrier/8e4dbd5cf28d493b858deb9c9fc59266, entries=1, sequenceid=21, filesize=5.0 K 2023-02-15 23:01:43,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/.tmp/table/6d4a9302f18d4f428b8c2fb25129d938 as hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/table/6d4a9302f18d4f428b8c2fb25129d938 2023-02-15 23:01:43,523 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d4a9302f18d4f428b8c2fb25129d938 2023-02-15 23:01:43,524 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/table/6d4a9302f18d4f428b8c2fb25129d938, entries=4, sequenceid=21, filesize=5.1 K 2023-02-15 23:01:43,527 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=21, compaction requested=false 2023-02-15 23:01:43,530 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 23:01:43,531 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 23:01:43,531 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:43,531 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:43,531 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:43,546 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:43,547 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:43,576 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:43,576 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37859,1676502100548 2023-02-15 23:01:43,576 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:43,576 ERROR [Listener at localhost/35227-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b97c265 rejected from java.util.concurrent.ThreadPoolExecutor@1fa855cf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:43,576 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:43,577 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:43,577 ERROR [Listener at localhost/35227-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e9bb072 rejected from java.util.concurrent.ThreadPoolExecutor@1fa855cf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:43,578 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37859,1676502100548] 2023-02-15 23:01:43,578 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37859,1676502100548; numProcessing=1 2023-02-15 23:01:43,579 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37859,1676502100548 already deleted, retry=false 2023-02-15 23:01:43,579 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37859,1676502100548 expired; onlineServers=1 2023-02-15 23:01:43,673 INFO [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34947,1676502100571; all regions closed. 2023-02-15 23:01:43,677 DEBUG [RS:1;jenkins-hbase4:34947] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/oldWALs 2023-02-15 23:01:43,677 INFO [RS:1;jenkins-hbase4:34947] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34947%2C1676502100571.meta:.meta(num 1676502101066) 2023-02-15 23:01:43,680 DEBUG [RS:1;jenkins-hbase4:34947] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/oldWALs 2023-02-15 23:01:43,680 INFO [RS:1;jenkins-hbase4:34947] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34947%2C1676502100571:(num 1676502101476) 2023-02-15 23:01:43,680 DEBUG [RS:1;jenkins-hbase4:34947] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:43,680 INFO [RS:1;jenkins-hbase4:34947] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:43,681 INFO [RS:1;jenkins-hbase4:34947] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:43,681 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:43,682 INFO [RS:1;jenkins-hbase4:34947] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34947 2023-02-15 23:01:43,685 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34947,1676502100571 2023-02-15 23:01:43,685 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:43,685 ERROR [Listener at localhost/35227-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@73fcbae2 rejected from java.util.concurrent.ThreadPoolExecutor@77c33045[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:43,686 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34947,1676502100571] 2023-02-15 23:01:43,687 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34947,1676502100571; numProcessing=2 2023-02-15 23:01:43,688 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34947,1676502100571 already deleted, retry=false 2023-02-15 23:01:43,688 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34947,1676502100571 expired; onlineServers=0 2023-02-15 23:01:43,688 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35295,1676502100495' ***** 2023-02-15 23:01:43,688 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 23:01:43,689 DEBUG [M:0;jenkins-hbase4:35295] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@286a91b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:43,689 INFO [M:0;jenkins-hbase4:35295] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35295,1676502100495 2023-02-15 23:01:43,689 INFO [M:0;jenkins-hbase4:35295] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35295,1676502100495; all regions closed. 2023-02-15 23:01:43,689 DEBUG [M:0;jenkins-hbase4:35295] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:43,689 DEBUG [M:0;jenkins-hbase4:35295] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 23:01:43,689 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 23:01:43,689 DEBUG [M:0;jenkins-hbase4:35295] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 23:01:43,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502100720] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502100720,5,FailOnTimeoutGroup] 2023-02-15 23:01:43,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502100721] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502100721,5,FailOnTimeoutGroup] 2023-02-15 23:01:43,689 INFO [M:0;jenkins-hbase4:35295] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 23:01:43,690 INFO [M:0;jenkins-hbase4:35295] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 23:01:43,690 INFO [M:0;jenkins-hbase4:35295] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 23:01:43,690 DEBUG [M:0;jenkins-hbase4:35295] master.HMaster(1512): Stopping service threads 2023-02-15 23:01:43,691 INFO [M:0;jenkins-hbase4:35295] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 23:01:43,691 ERROR [M:0;jenkins-hbase4:35295] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 23:01:43,691 INFO [M:0;jenkins-hbase4:35295] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 23:01:43,691 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 23:01:43,691 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:43,691 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:43,692 DEBUG [M:0;jenkins-hbase4:35295] zookeeper.ZKUtil(398): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 23:01:43,692 WARN [M:0;jenkins-hbase4:35295] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 23:01:43,692 INFO [M:0;jenkins-hbase4:35295] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 23:01:43,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:43,692 INFO [M:0;jenkins-hbase4:35295] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 23:01:43,692 DEBUG [M:0;jenkins-hbase4:35295] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:43,692 INFO [M:0;jenkins-hbase4:35295] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:43,692 DEBUG [M:0;jenkins-hbase4:35295] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:43,692 DEBUG [M:0;jenkins-hbase4:35295] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:43,692 DEBUG [M:0;jenkins-hbase4:35295] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:43,692 INFO [M:0;jenkins-hbase4:35295] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.13 KB heapSize=67.07 KB 2023-02-15 23:01:43,701 INFO [M:0;jenkins-hbase4:35295] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.13 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a8f0a7d8c653480d99233579c0bf17c4 2023-02-15 23:01:43,704 DEBUG [M:0;jenkins-hbase4:35295] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a8f0a7d8c653480d99233579c0bf17c4 as hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a8f0a7d8c653480d99233579c0bf17c4 2023-02-15 23:01:43,707 INFO [M:0;jenkins-hbase4:35295] regionserver.HStore(1080): Added hdfs://localhost:36163/user/jenkins/test-data/69877cdd-cb1b-ef02-10a9-986ce1b0d12c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a8f0a7d8c653480d99233579c0bf17c4, entries=17, sequenceid=132, filesize=8.7 K 2023-02-15 23:01:43,708 INFO [M:0;jenkins-hbase4:35295] regionserver.HRegion(2947): Finished flush of dataSize ~56.13 KB/57482, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-15 23:01:43,712 INFO [M:0;jenkins-hbase4:35295] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:43,712 DEBUG [M:0;jenkins-hbase4:35295] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:43,715 INFO [M:0;jenkins-hbase4:35295] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 23:01:43,715 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:43,715 INFO [M:0;jenkins-hbase4:35295] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35295 2023-02-15 23:01:43,719 DEBUG [M:0;jenkins-hbase4:35295] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35295,1676502100495 already deleted, retry=false 2023-02-15 23:01:43,870 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:43,870 INFO [M:0;jenkins-hbase4:35295] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35295,1676502100495; zookeeper connection closed. 2023-02-15 23:01:43,870 ERROR [Listener at localhost/35227-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2207edb7 rejected from java.util.concurrent.ThreadPoolExecutor@26387d2f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:43,871 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): master:35295-0x1005a37d3c30000, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:43,871 ERROR [Listener at localhost/35227-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4f64675a rejected from java.util.concurrent.ThreadPoolExecutor@26387d2f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:43,970 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:43,970 INFO [RS:1;jenkins-hbase4:34947] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34947,1676502100571; zookeeper connection closed. 2023-02-15 23:01:43,970 ERROR [Listener at localhost/35227-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1504a747 rejected from java.util.concurrent.ThreadPoolExecutor@77c33045[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:43,973 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@212b9132] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@212b9132 2023-02-15 23:01:43,973 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:34947-0x1005a37d3c30002, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:43,973 ERROR [Listener at localhost/35227-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d966d85 rejected from java.util.concurrent.ThreadPoolExecutor@77c33045[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:44,070 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:44,070 INFO [RS:0;jenkins-hbase4:37859] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37859,1676502100548; zookeeper connection closed. 2023-02-15 23:01:44,071 ERROR [Listener at localhost/35227-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@36e1f1ab rejected from java.util.concurrent.ThreadPoolExecutor@1fa855cf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:44,071 DEBUG [Listener at localhost/35227-EventThread] zookeeper.ZKWatcher(600): regionserver:37859-0x1005a37d3c30001, quorum=127.0.0.1:50939, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:44,071 ERROR [Listener at localhost/35227-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@290e0813 rejected from java.util.concurrent.ThreadPoolExecutor@1fa855cf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:44,071 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@430b5171] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@430b5171 2023-02-15 23:01:44,072 INFO [Listener at localhost/35227] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 23:01:44,072 WARN [Listener at localhost/35227] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:44,075 INFO [Listener at localhost/35227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:44,180 WARN [BP-780537256-172.31.14.131-1676502099812 heartbeating to localhost/127.0.0.1:36163] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 23:01:44,181 WARN [BP-780537256-172.31.14.131-1676502099812 heartbeating to localhost/127.0.0.1:36163] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-780537256-172.31.14.131-1676502099812 (Datanode Uuid f35364ce-81f7-4532-baa5-b97368927d7c) service to localhost/127.0.0.1:36163 2023-02-15 23:01:44,181 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/cluster_7898d070-e9a8-071d-89b3-c02a750131d4/dfs/data/data3/current/BP-780537256-172.31.14.131-1676502099812] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:44,181 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/cluster_7898d070-e9a8-071d-89b3-c02a750131d4/dfs/data/data4/current/BP-780537256-172.31.14.131-1676502099812] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:44,183 WARN [Listener at localhost/35227] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:44,185 INFO [Listener at localhost/35227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:44,289 WARN [BP-780537256-172.31.14.131-1676502099812 heartbeating to localhost/127.0.0.1:36163] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 23:01:44,289 WARN [BP-780537256-172.31.14.131-1676502099812 heartbeating to localhost/127.0.0.1:36163] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-780537256-172.31.14.131-1676502099812 (Datanode Uuid 1494786c-61be-4959-bbe0-ae9328e0aa17) service to localhost/127.0.0.1:36163 2023-02-15 23:01:44,290 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/cluster_7898d070-e9a8-071d-89b3-c02a750131d4/dfs/data/data1/current/BP-780537256-172.31.14.131-1676502099812] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:44,290 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/cluster_7898d070-e9a8-071d-89b3-c02a750131d4/dfs/data/data2/current/BP-780537256-172.31.14.131-1676502099812] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:44,299 INFO [Listener at localhost/35227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:44,411 INFO [Listener at localhost/35227] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 23:01:44,425 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 23:01:44,437 INFO [Listener at localhost/35227] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=253 (was 228) Potentially hanging thread: Listener at localhost/35227.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:36163 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35227 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:36163 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36163 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:36163 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'NameNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:36163 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:36163 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:36163 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35295,1676502100495)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=660 (was 643) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=336 (was 339), ProcessCount=166 (was 166), AvailableMemoryMB=2557 (was 2579) 2023-02-15 23:01:44,447 INFO [Listener at localhost/35227] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=253, OpenFileDescriptor=660, MaxFileDescriptor=60000, SystemLoadAverage=336, ProcessCount=166, AvailableMemoryMB=2557 2023-02-15 23:01:44,457 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/hadoop.log.dir so I do NOT create it in target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db 2023-02-15 23:01:44,457 WARN [Listener at localhost/35227] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 23:01:44,457 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/hadoop.tmp.dir so I do NOT create it in target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db 2023-02-15 23:01:44,457 WARN [Listener at localhost/35227] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/63f60179-fa55-a093-7ce4-8e3d450f163d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 23:01:44,457 DEBUG [Listener at localhost/35227] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db 2023-02-15 23:01:44,457 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 23:01:44,457 INFO [Listener at localhost/35227] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/cluster_229599b0-5278-ca1f-a737-44c4a03d3a26, deleteOnExit=true 2023-02-15 23:01:44,457 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 23:01:44,458 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/test.cache.data in system properties and HBase conf 2023-02-15 23:01:44,458 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 23:01:44,458 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/hadoop.log.dir in system properties and HBase conf 2023-02-15 23:01:44,458 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 23:01:44,458 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 23:01:44,458 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 23:01:44,458 DEBUG [Listener at localhost/35227] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 23:01:44,458 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:01:44,458 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:01:44,458 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 23:01:44,459 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:01:44,459 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 23:01:44,459 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 23:01:44,459 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:01:44,459 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:01:44,459 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 23:01:44,459 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/nfs.dump.dir in system properties and HBase conf 2023-02-15 23:01:44,459 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/java.io.tmpdir in system properties and HBase conf 2023-02-15 23:01:44,459 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:01:44,459 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 23:01:44,459 INFO [Listener at localhost/35227] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 23:01:44,464 WARN [Listener at localhost/35227] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:01:44,464 WARN [Listener at localhost/35227] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:01:44,499 WARN [Listener at localhost/35227] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:44,502 INFO [Listener at localhost/35227] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:44,507 INFO [Listener at localhost/35227] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/java.io.tmpdir/Jetty_localhost_40909_hdfs____5a0hps/webapp 2023-02-15 23:01:44,599 INFO [Listener at localhost/35227] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40909 2023-02-15 23:01:44,603 WARN [Listener at localhost/35227] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:01:44,603 WARN [Listener at localhost/35227] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:01:44,649 WARN [Listener at localhost/46623] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:44,665 WARN [Listener at localhost/46623] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:01:44,667 WARN [Listener at localhost/46623] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:44,668 INFO [Listener at localhost/46623] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:44,673 INFO [Listener at localhost/46623] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/java.io.tmpdir/Jetty_localhost_34087_datanode____.1t2nl7/webapp 2023-02-15 23:01:44,765 INFO [Listener at localhost/46623] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34087 2023-02-15 23:01:44,772 WARN [Listener at localhost/35781] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:44,787 WARN [Listener at localhost/35781] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:01:44,789 WARN [Listener at localhost/35781] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:44,790 INFO [Listener at localhost/35781] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:44,794 INFO [Listener at localhost/35781] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/java.io.tmpdir/Jetty_localhost_39327_datanode____9wo5fd/webapp 2023-02-15 23:01:44,865 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x104e7e6da975bae9: Processing first storage report for DS-9e1386e9-6756-4fb8-9f44-4ff5edafd265 from datanode dbc5b284-101c-47ce-af17-f1561f331e5c 2023-02-15 23:01:44,865 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x104e7e6da975bae9: from storage DS-9e1386e9-6756-4fb8-9f44-4ff5edafd265 node DatanodeRegistration(127.0.0.1:43665, datanodeUuid=dbc5b284-101c-47ce-af17-f1561f331e5c, infoPort=40751, infoSecurePort=0, ipcPort=35781, storageInfo=lv=-57;cid=testClusterID;nsid=1722895544;c=1676502104466), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:44,866 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x104e7e6da975bae9: Processing first storage report for DS-a8d3084e-cec0-4b51-b43a-fe3739fa7291 from datanode dbc5b284-101c-47ce-af17-f1561f331e5c 2023-02-15 23:01:44,866 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x104e7e6da975bae9: from storage DS-a8d3084e-cec0-4b51-b43a-fe3739fa7291 node DatanodeRegistration(127.0.0.1:43665, datanodeUuid=dbc5b284-101c-47ce-af17-f1561f331e5c, infoPort=40751, infoSecurePort=0, ipcPort=35781, storageInfo=lv=-57;cid=testClusterID;nsid=1722895544;c=1676502104466), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 23:01:44,891 INFO [Listener at localhost/35781] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39327 2023-02-15 23:01:44,901 WARN [Listener at localhost/34643] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:44,994 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x85c19c782dfe88f9: Processing first storage report for DS-e8ddcba8-a824-4ccf-bda4-b43c98bfe9b5 from datanode 4d79103b-65ca-424d-bcf3-131c8d083650 2023-02-15 23:01:44,994 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x85c19c782dfe88f9: from storage DS-e8ddcba8-a824-4ccf-bda4-b43c98bfe9b5 node DatanodeRegistration(127.0.0.1:44239, datanodeUuid=4d79103b-65ca-424d-bcf3-131c8d083650, infoPort=39213, infoSecurePort=0, ipcPort=34643, storageInfo=lv=-57;cid=testClusterID;nsid=1722895544;c=1676502104466), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:44,994 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x85c19c782dfe88f9: Processing first storage report for DS-3e810c76-146b-4f45-8e9f-e420203ff1fa from datanode 4d79103b-65ca-424d-bcf3-131c8d083650 2023-02-15 23:01:44,994 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x85c19c782dfe88f9: from storage DS-3e810c76-146b-4f45-8e9f-e420203ff1fa node DatanodeRegistration(127.0.0.1:44239, datanodeUuid=4d79103b-65ca-424d-bcf3-131c8d083650, infoPort=39213, infoSecurePort=0, ipcPort=34643, storageInfo=lv=-57;cid=testClusterID;nsid=1722895544;c=1676502104466), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:45,009 DEBUG [Listener at localhost/34643] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db 2023-02-15 23:01:45,011 INFO [Listener at localhost/34643] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/cluster_229599b0-5278-ca1f-a737-44c4a03d3a26/zookeeper_0, clientPort=53274, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/cluster_229599b0-5278-ca1f-a737-44c4a03d3a26/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/cluster_229599b0-5278-ca1f-a737-44c4a03d3a26/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 23:01:45,015 INFO [Listener at localhost/34643] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53274 2023-02-15 23:01:45,015 INFO [Listener at localhost/34643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:45,016 INFO [Listener at localhost/34643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:45,032 INFO [Listener at localhost/34643] util.FSUtils(479): Created version file at hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c with version=8 2023-02-15 23:01:45,033 INFO [Listener at localhost/34643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:45,034 INFO [Listener at localhost/34643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:45,035 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46623/user/jenkins/test-data/23c7bbc1-5c7e-69b6-c9e3-db5f47d96ac1/hbase-staging 2023-02-15 23:01:45,037 INFO [Listener at localhost/34643] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:45,038 INFO [Listener at localhost/34643] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:45,038 INFO [Listener at localhost/34643] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:45,038 INFO [Listener at localhost/34643] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:45,038 INFO [Listener at localhost/34643] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:45,038 INFO [Listener at localhost/34643] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:45,038 INFO [Listener at localhost/34643] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:45,039 INFO [Listener at localhost/34643] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46037 2023-02-15 23:01:45,040 INFO [Listener at localhost/34643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:45,041 INFO [Listener at localhost/34643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:45,041 INFO [Listener at localhost/34643] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46037 connecting to ZooKeeper ensemble=127.0.0.1:53274 2023-02-15 23:01:45,049 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:460370x0, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:45,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:46037-0x1005a37e5780000 connected 2023-02-15 23:01:45,069 DEBUG [Listener at localhost/34643] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:45,069 DEBUG [Listener at localhost/34643] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:45,069 DEBUG [Listener at localhost/34643] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:45,071 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46037 2023-02-15 23:01:45,071 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46037 2023-02-15 23:01:45,071 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46037 2023-02-15 23:01:45,071 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46037 2023-02-15 23:01:45,072 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46037 2023-02-15 23:01:45,072 INFO [Listener at localhost/34643] master.HMaster(444): hbase.rootdir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c, hbase.cluster.distributed=false 2023-02-15 23:01:45,087 INFO [Listener at localhost/34643] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:45,087 INFO [Listener at localhost/34643] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:45,087 INFO [Listener at localhost/34643] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:45,087 INFO [Listener at localhost/34643] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:45,088 INFO [Listener at localhost/34643] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:45,088 INFO [Listener at localhost/34643] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:45,088 INFO [Listener at localhost/34643] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:45,089 INFO [Listener at localhost/34643] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34933 2023-02-15 23:01:45,089 INFO [Listener at localhost/34643] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:45,089 DEBUG [Listener at localhost/34643] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:45,090 INFO [Listener at localhost/34643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:45,091 INFO [Listener at localhost/34643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:45,091 INFO [Listener at localhost/34643] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34933 connecting to ZooKeeper ensemble=127.0.0.1:53274 2023-02-15 23:01:45,093 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:349330x0, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:45,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34933-0x1005a37e5780001 connected 2023-02-15 23:01:45,095 DEBUG [Listener at localhost/34643] zookeeper.ZKUtil(164): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:45,095 DEBUG [Listener at localhost/34643] zookeeper.ZKUtil(164): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:45,095 DEBUG [Listener at localhost/34643] zookeeper.ZKUtil(164): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:45,096 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34933 2023-02-15 23:01:45,098 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34933 2023-02-15 23:01:45,099 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34933 2023-02-15 23:01:45,101 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34933 2023-02-15 23:01:45,104 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34933 2023-02-15 23:01:45,114 INFO [Listener at localhost/34643] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:45,114 INFO [Listener at localhost/34643] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:45,114 INFO [Listener at localhost/34643] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:45,114 INFO [Listener at localhost/34643] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:45,115 INFO [Listener at localhost/34643] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:45,115 INFO [Listener at localhost/34643] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:45,115 INFO [Listener at localhost/34643] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:45,115 INFO [Listener at localhost/34643] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41289 2023-02-15 23:01:45,116 INFO [Listener at localhost/34643] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:45,116 DEBUG [Listener at localhost/34643] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:45,116 INFO [Listener at localhost/34643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:45,117 INFO [Listener at localhost/34643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:45,118 INFO [Listener at localhost/34643] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41289 connecting to ZooKeeper ensemble=127.0.0.1:53274 2023-02-15 23:01:45,120 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:412890x0, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:45,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41289-0x1005a37e5780002 connected 2023-02-15 23:01:45,122 DEBUG [Listener at localhost/34643] zookeeper.ZKUtil(164): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:45,122 DEBUG [Listener at localhost/34643] zookeeper.ZKUtil(164): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:45,123 DEBUG [Listener at localhost/34643] zookeeper.ZKUtil(164): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:45,124 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41289 2023-02-15 23:01:45,124 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41289 2023-02-15 23:01:45,124 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41289 2023-02-15 23:01:45,128 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41289 2023-02-15 23:01:45,132 DEBUG [Listener at localhost/34643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41289 2023-02-15 23:01:45,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46037,1676502105037 2023-02-15 23:01:45,135 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:45,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46037,1676502105037 2023-02-15 23:01:45,138 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:45,138 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:45,138 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:45,138 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:45,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:45,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46037,1676502105037 from backup master directory 2023-02-15 23:01:45,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:45,142 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46037,1676502105037 2023-02-15 23:01:45,142 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:45,142 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:45,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46037,1676502105037 2023-02-15 23:01:45,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/hbase.id with ID: 817345e1-1bba-47a7-baa4-4fd10a573578 2023-02-15 23:01:45,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:45,165 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:45,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1d96c30d to 127.0.0.1:53274 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:45,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d7de65e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:45,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:45,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 23:01:45,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:45,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/MasterData/data/master/store-tmp 2023-02-15 23:01:45,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:45,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:45,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:45,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:45,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:45,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:45,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:45,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:45,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/MasterData/WALs/jenkins-hbase4.apache.org,46037,1676502105037 2023-02-15 23:01:45,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46037%2C1676502105037, suffix=, logDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/MasterData/WALs/jenkins-hbase4.apache.org,46037,1676502105037, archiveDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/MasterData/oldWALs, maxLogs=10 2023-02-15 23:01:45,208 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43665,DS-9e1386e9-6756-4fb8-9f44-4ff5edafd265,DISK] 2023-02-15 23:01:45,209 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44239,DS-e8ddcba8-a824-4ccf-bda4-b43c98bfe9b5,DISK] 2023-02-15 23:01:45,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/MasterData/WALs/jenkins-hbase4.apache.org,46037,1676502105037/jenkins-hbase4.apache.org%2C46037%2C1676502105037.1676502105192 2023-02-15 23:01:45,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43665,DS-9e1386e9-6756-4fb8-9f44-4ff5edafd265,DISK], DatanodeInfoWithStorage[127.0.0.1:44239,DS-e8ddcba8-a824-4ccf-bda4-b43c98bfe9b5,DISK]] 2023-02-15 23:01:45,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:45,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:45,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:45,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:45,214 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:45,215 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 23:01:45,216 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 23:01:45,216 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:45,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:45,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:45,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:45,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:45,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67433263, jitterRate=0.004833921790122986}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:45,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:45,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 23:01:45,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 23:01:45,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 23:01:45,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 23:01:45,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 23:01:45,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 23:01:45,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 23:01:45,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 23:01:45,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 23:01:45,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 23:01:45,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 23:01:45,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 23:01:45,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 23:01:45,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 23:01:45,238 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:45,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 23:01:45,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 23:01:45,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 23:01:45,240 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:45,240 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:45,240 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:45,240 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:45,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46037,1676502105037, sessionid=0x1005a37e5780000, setting cluster-up flag (Was=false) 2023-02-15 23:01:45,246 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:45,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 23:01:45,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46037,1676502105037 2023-02-15 23:01:45,255 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:45,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 23:01:45,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46037,1676502105037 2023-02-15 23:01:45,258 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.hbase-snapshot/.tmp 2023-02-15 23:01:45,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:45,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:45,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:45,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:45,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:45,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 23:01:45,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:45,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676502135261 2023-02-15 23:01:45,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 23:01:45,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 23:01:45,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 23:01:45,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 23:01:45,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 23:01:45,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 23:01:45,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,262 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:45,262 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 23:01:45,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 23:01:45,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 23:01:45,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 23:01:45,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 23:01:45,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 23:01:45,264 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:45,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502105263,5,FailOnTimeoutGroup] 2023-02-15 23:01:45,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502105264,5,FailOnTimeoutGroup] 2023-02-15 23:01:45,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 23:01:45,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,275 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:45,275 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:45,275 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c 2023-02-15 23:01:45,329 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:45,330 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:45,331 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/info 2023-02-15 23:01:45,331 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:45,332 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:45,332 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:45,333 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:45,334 INFO [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(952): ClusterId : 817345e1-1bba-47a7-baa4-4fd10a573578 2023-02-15 23:01:45,334 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:45,334 INFO [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(952): ClusterId : 817345e1-1bba-47a7-baa4-4fd10a573578 2023-02-15 23:01:45,334 DEBUG [RS:0;jenkins-hbase4:34933] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:45,334 DEBUG [RS:1;jenkins-hbase4:41289] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:45,334 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:45,334 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:45,335 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/table 2023-02-15 23:01:45,335 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:45,336 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:45,336 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740 2023-02-15 23:01:45,337 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740 2023-02-15 23:01:45,337 DEBUG [RS:1;jenkins-hbase4:41289] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:45,337 DEBUG [RS:1;jenkins-hbase4:41289] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:45,337 DEBUG [RS:0;jenkins-hbase4:34933] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:45,337 DEBUG [RS:0;jenkins-hbase4:34933] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:45,339 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:45,339 DEBUG [RS:0;jenkins-hbase4:34933] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:45,339 DEBUG [RS:1;jenkins-hbase4:41289] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:45,340 DEBUG [RS:0;jenkins-hbase4:34933] zookeeper.ReadOnlyZKClient(139): Connect 0x7e6c8576 to 127.0.0.1:53274 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:45,340 DEBUG [RS:1;jenkins-hbase4:41289] zookeeper.ReadOnlyZKClient(139): Connect 0x0344a73d to 127.0.0.1:53274 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:45,341 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:45,345 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:45,345 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73217231, jitterRate=0.09102176129817963}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:45,345 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:45,345 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:45,346 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:45,346 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:45,346 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:45,346 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:45,346 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:45,346 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:45,347 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:45,347 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 23:01:45,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 23:01:45,347 DEBUG [RS:0;jenkins-hbase4:34933] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70ab64cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:45,347 DEBUG [RS:0;jenkins-hbase4:34933] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7494ee06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:45,347 DEBUG [RS:1;jenkins-hbase4:41289] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d834925, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:45,348 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 23:01:45,348 DEBUG [RS:1;jenkins-hbase4:41289] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9bccc4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:45,349 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 23:01:45,357 DEBUG [RS:0;jenkins-hbase4:34933] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34933 2023-02-15 23:01:45,357 INFO [RS:0;jenkins-hbase4:34933] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:45,357 INFO [RS:0;jenkins-hbase4:34933] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:45,357 DEBUG [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:45,358 INFO [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46037,1676502105037 with isa=jenkins-hbase4.apache.org/172.31.14.131:34933, startcode=1676502105087 2023-02-15 23:01:45,358 DEBUG [RS:0;jenkins-hbase4:34933] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:45,359 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41067, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:45,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:45,361 DEBUG [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c 2023-02-15 23:01:45,361 DEBUG [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46623 2023-02-15 23:01:45,361 DEBUG [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:45,362 DEBUG [RS:1;jenkins-hbase4:41289] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41289 2023-02-15 23:01:45,362 INFO [RS:1;jenkins-hbase4:41289] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:45,362 INFO [RS:1;jenkins-hbase4:41289] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:45,362 DEBUG [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:45,363 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:45,363 INFO [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46037,1676502105037 with isa=jenkins-hbase4.apache.org/172.31.14.131:41289, startcode=1676502105114 2023-02-15 23:01:45,363 DEBUG [RS:1;jenkins-hbase4:41289] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:45,363 DEBUG [RS:0;jenkins-hbase4:34933] zookeeper.ZKUtil(162): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:45,364 WARN [RS:0;jenkins-hbase4:34933] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:45,364 INFO [RS:0;jenkins-hbase4:34933] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:45,364 DEBUG [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/WALs/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:45,365 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34933,1676502105087] 2023-02-15 23:01:45,369 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51277, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:45,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:45,370 DEBUG [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c 2023-02-15 23:01:45,370 DEBUG [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46623 2023-02-15 23:01:45,370 DEBUG [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:45,370 DEBUG [RS:0;jenkins-hbase4:34933] zookeeper.ZKUtil(162): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:45,374 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:45,374 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:45,374 DEBUG [RS:1;jenkins-hbase4:41289] zookeeper.ZKUtil(162): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:45,374 WARN [RS:1;jenkins-hbase4:41289] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:45,374 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41289,1676502105114] 2023-02-15 23:01:45,375 INFO [RS:1;jenkins-hbase4:41289] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:45,375 DEBUG [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/WALs/jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:45,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:45,375 DEBUG [RS:0;jenkins-hbase4:34933] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:45,375 INFO [RS:0;jenkins-hbase4:34933] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:45,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:45,377 INFO [RS:0;jenkins-hbase4:34933] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:45,378 INFO [RS:0;jenkins-hbase4:34933] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:45,378 DEBUG [RS:1;jenkins-hbase4:41289] zookeeper.ZKUtil(162): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:45,378 INFO [RS:0;jenkins-hbase4:34933] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,378 INFO [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:45,378 DEBUG [RS:1;jenkins-hbase4:41289] zookeeper.ZKUtil(162): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:45,379 INFO [RS:0;jenkins-hbase4:34933] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,379 DEBUG [RS:0;jenkins-hbase4:34933] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,379 DEBUG [RS:0;jenkins-hbase4:34933] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,379 DEBUG [RS:1;jenkins-hbase4:41289] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:45,379 DEBUG [RS:0;jenkins-hbase4:34933] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,380 DEBUG [RS:0;jenkins-hbase4:34933] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,380 INFO [RS:1;jenkins-hbase4:41289] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:45,380 DEBUG [RS:0;jenkins-hbase4:34933] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,380 DEBUG [RS:0;jenkins-hbase4:34933] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:45,380 DEBUG [RS:0;jenkins-hbase4:34933] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,380 DEBUG [RS:0;jenkins-hbase4:34933] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,380 DEBUG [RS:0;jenkins-hbase4:34933] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,380 DEBUG [RS:0;jenkins-hbase4:34933] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,384 INFO [RS:1;jenkins-hbase4:41289] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:45,385 INFO [RS:0;jenkins-hbase4:34933] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,385 INFO [RS:0;jenkins-hbase4:34933] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,385 INFO [RS:1;jenkins-hbase4:41289] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:45,385 INFO [RS:0;jenkins-hbase4:34933] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,385 INFO [RS:1;jenkins-hbase4:41289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,385 INFO [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:45,386 INFO [RS:1;jenkins-hbase4:41289] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,387 DEBUG [RS:1;jenkins-hbase4:41289] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,387 DEBUG [RS:1;jenkins-hbase4:41289] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,387 DEBUG [RS:1;jenkins-hbase4:41289] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,387 DEBUG [RS:1;jenkins-hbase4:41289] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,387 DEBUG [RS:1;jenkins-hbase4:41289] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,387 DEBUG [RS:1;jenkins-hbase4:41289] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:45,387 DEBUG [RS:1;jenkins-hbase4:41289] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,387 DEBUG [RS:1;jenkins-hbase4:41289] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,387 DEBUG [RS:1;jenkins-hbase4:41289] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,387 DEBUG [RS:1;jenkins-hbase4:41289] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:45,389 INFO [RS:1;jenkins-hbase4:41289] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,389 INFO [RS:1;jenkins-hbase4:41289] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,390 INFO [RS:1;jenkins-hbase4:41289] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,397 INFO [RS:0;jenkins-hbase4:34933] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:45,397 INFO [RS:0;jenkins-hbase4:34933] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34933,1676502105087-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,400 INFO [RS:1;jenkins-hbase4:41289] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:45,400 INFO [RS:1;jenkins-hbase4:41289] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41289,1676502105114-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,412 INFO [RS:0;jenkins-hbase4:34933] regionserver.Replication(203): jenkins-hbase4.apache.org,34933,1676502105087 started 2023-02-15 23:01:45,412 INFO [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34933,1676502105087, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34933, sessionid=0x1005a37e5780001 2023-02-15 23:01:45,412 DEBUG [RS:0;jenkins-hbase4:34933] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:45,412 DEBUG [RS:0;jenkins-hbase4:34933] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:45,412 DEBUG [RS:0;jenkins-hbase4:34933] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34933,1676502105087' 2023-02-15 23:01:45,412 DEBUG [RS:0;jenkins-hbase4:34933] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:45,412 DEBUG [RS:0;jenkins-hbase4:34933] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:45,413 DEBUG [RS:0;jenkins-hbase4:34933] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:45,413 DEBUG [RS:0;jenkins-hbase4:34933] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:45,413 DEBUG [RS:0;jenkins-hbase4:34933] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:45,413 DEBUG [RS:0;jenkins-hbase4:34933] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34933,1676502105087' 2023-02-15 23:01:45,413 DEBUG [RS:0;jenkins-hbase4:34933] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:45,413 DEBUG [RS:0;jenkins-hbase4:34933] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:45,413 DEBUG [RS:0;jenkins-hbase4:34933] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:45,413 INFO [RS:0;jenkins-hbase4:34933] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:45,413 INFO [RS:0;jenkins-hbase4:34933] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:45,414 INFO [RS:1;jenkins-hbase4:41289] regionserver.Replication(203): jenkins-hbase4.apache.org,41289,1676502105114 started 2023-02-15 23:01:45,414 INFO [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41289,1676502105114, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41289, sessionid=0x1005a37e5780002 2023-02-15 23:01:45,414 DEBUG [RS:1;jenkins-hbase4:41289] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:45,414 DEBUG [RS:1;jenkins-hbase4:41289] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:45,414 DEBUG [RS:1;jenkins-hbase4:41289] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41289,1676502105114' 2023-02-15 23:01:45,414 DEBUG [RS:1;jenkins-hbase4:41289] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:45,414 DEBUG [RS:1;jenkins-hbase4:41289] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:45,415 DEBUG [RS:1;jenkins-hbase4:41289] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:45,415 DEBUG [RS:1;jenkins-hbase4:41289] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:45,415 DEBUG [RS:1;jenkins-hbase4:41289] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:45,415 DEBUG [RS:1;jenkins-hbase4:41289] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41289,1676502105114' 2023-02-15 23:01:45,415 DEBUG [RS:1;jenkins-hbase4:41289] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:45,415 DEBUG [RS:1;jenkins-hbase4:41289] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:45,415 DEBUG [RS:1;jenkins-hbase4:41289] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:45,415 INFO [RS:1;jenkins-hbase4:41289] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:45,415 INFO [RS:1;jenkins-hbase4:41289] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:45,500 DEBUG [jenkins-hbase4:46037] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 23:01:45,500 DEBUG [jenkins-hbase4:46037] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:45,501 DEBUG [jenkins-hbase4:46037] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:45,501 DEBUG [jenkins-hbase4:46037] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:45,501 DEBUG [jenkins-hbase4:46037] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:45,501 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41289,1676502105114, state=OPENING 2023-02-15 23:01:45,503 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 23:01:45,504 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:45,504 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:45,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41289,1676502105114}] 2023-02-15 23:01:45,659 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:45,659 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:45,661 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59804, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:45,664 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 23:01:45,664 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:45,665 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41289%2C1676502105114.meta, suffix=.meta, logDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/WALs/jenkins-hbase4.apache.org,41289,1676502105114, archiveDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/oldWALs, maxLogs=32 2023-02-15 23:01:45,684 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43665,DS-9e1386e9-6756-4fb8-9f44-4ff5edafd265,DISK] 2023-02-15 23:01:45,684 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44239,DS-e8ddcba8-a824-4ccf-bda4-b43c98bfe9b5,DISK] 2023-02-15 23:01:45,688 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/WALs/jenkins-hbase4.apache.org,41289,1676502105114/jenkins-hbase4.apache.org%2C41289%2C1676502105114.meta.1676502105666.meta 2023-02-15 23:01:45,688 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43665,DS-9e1386e9-6756-4fb8-9f44-4ff5edafd265,DISK], DatanodeInfoWithStorage[127.0.0.1:44239,DS-e8ddcba8-a824-4ccf-bda4-b43c98bfe9b5,DISK]] 2023-02-15 23:01:45,688 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:45,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 23:01:45,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 23:01:45,689 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 23:01:45,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 23:01:45,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:45,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 23:01:45,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 23:01:45,690 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:45,691 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/info 2023-02-15 23:01:45,691 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/info 2023-02-15 23:01:45,691 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:45,692 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:45,692 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:45,693 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:45,693 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:45,693 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:45,693 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:45,693 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:45,694 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/table 2023-02-15 23:01:45,694 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/table 2023-02-15 23:01:45,694 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:45,695 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:45,695 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740 2023-02-15 23:01:45,696 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740 2023-02-15 23:01:45,698 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:45,699 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:45,699 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74921966, jitterRate=0.11642429232597351}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:45,699 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:45,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676502105659 2023-02-15 23:01:45,703 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 23:01:45,704 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 23:01:45,704 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41289,1676502105114, state=OPEN 2023-02-15 23:01:45,707 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 23:01:45,707 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:45,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 23:01:45,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41289,1676502105114 in 203 msec 2023-02-15 23:01:45,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 23:01:45,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-15 23:01:45,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 450 msec 2023-02-15 23:01:45,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676502105710, completionTime=-1 2023-02-15 23:01:45,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 23:01:45,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 23:01:45,712 DEBUG [hconnection-0x3c403463-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:45,713 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59820, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:45,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 23:01:45,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676502165715 2023-02-15 23:01:45,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676502225715 2023-02-15 23:01:45,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-15 23:01:45,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46037,1676502105037-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46037,1676502105037-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46037,1676502105037-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46037, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:45,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 23:01:45,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:45,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 23:01:45,725 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 23:01:45,725 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:45,726 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:45,727 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/hbase/namespace/e8c9a9c8d7f85372b33b812768a5294e 2023-02-15 23:01:45,727 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/hbase/namespace/e8c9a9c8d7f85372b33b812768a5294e empty. 2023-02-15 23:01:45,728 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/hbase/namespace/e8c9a9c8d7f85372b33b812768a5294e 2023-02-15 23:01:45,728 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 23:01:45,735 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:45,736 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e8c9a9c8d7f85372b33b812768a5294e, NAME => 'hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp 2023-02-15 23:01:45,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:45,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e8c9a9c8d7f85372b33b812768a5294e, disabling compactions & flushes 2023-02-15 23:01:45,744 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. 2023-02-15 23:01:45,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. 2023-02-15 23:01:45,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. after waiting 0 ms 2023-02-15 23:01:45,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. 2023-02-15 23:01:45,744 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. 2023-02-15 23:01:45,744 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e8c9a9c8d7f85372b33b812768a5294e: 2023-02-15 23:01:45,745 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:45,746 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502105746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502105746"}]},"ts":"1676502105746"} 2023-02-15 23:01:45,747 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 23:01:45,748 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:45,748 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502105748"}]},"ts":"1676502105748"} 2023-02-15 23:01:45,749 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 23:01:45,753 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:45,753 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:45,753 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:45,753 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:45,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e8c9a9c8d7f85372b33b812768a5294e, ASSIGN}] 2023-02-15 23:01:45,756 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e8c9a9c8d7f85372b33b812768a5294e, ASSIGN 2023-02-15 23:01:45,756 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e8c9a9c8d7f85372b33b812768a5294e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34933,1676502105087; forceNewPlan=false, retain=false 2023-02-15 23:01:45,906 INFO [jenkins-hbase4:46037] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 23:01:45,907 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e8c9a9c8d7f85372b33b812768a5294e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:45,907 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502105907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502105907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502105907"}]},"ts":"1676502105907"} 2023-02-15 23:01:45,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e8c9a9c8d7f85372b33b812768a5294e, server=jenkins-hbase4.apache.org,34933,1676502105087}] 2023-02-15 23:01:46,061 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:46,061 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:46,063 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46962, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:46,067 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. 2023-02-15 23:01:46,068 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34933%2C1676502105087, suffix=, logDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/WALs/jenkins-hbase4.apache.org,34933,1676502105087, archiveDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/oldWALs, maxLogs=32 2023-02-15 23:01:46,083 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43665,DS-9e1386e9-6756-4fb8-9f44-4ff5edafd265,DISK] 2023-02-15 23:01:46,083 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44239,DS-e8ddcba8-a824-4ccf-bda4-b43c98bfe9b5,DISK] 2023-02-15 23:01:46,085 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/WALs/jenkins-hbase4.apache.org,34933,1676502105087/jenkins-hbase4.apache.org%2C34933%2C1676502105087.1676502106068 2023-02-15 23:01:46,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43665,DS-9e1386e9-6756-4fb8-9f44-4ff5edafd265,DISK], DatanodeInfoWithStorage[127.0.0.1:44239,DS-e8ddcba8-a824-4ccf-bda4-b43c98bfe9b5,DISK]] 2023-02-15 23:01:46,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e8c9a9c8d7f85372b33b812768a5294e, NAME => 'hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:46,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e8c9a9c8d7f85372b33b812768a5294e 2023-02-15 23:01:46,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:46,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e8c9a9c8d7f85372b33b812768a5294e 2023-02-15 23:01:46,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e8c9a9c8d7f85372b33b812768a5294e 2023-02-15 23:01:46,086 INFO [StoreOpener-e8c9a9c8d7f85372b33b812768a5294e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e8c9a9c8d7f85372b33b812768a5294e 2023-02-15 23:01:46,088 DEBUG [StoreOpener-e8c9a9c8d7f85372b33b812768a5294e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/namespace/e8c9a9c8d7f85372b33b812768a5294e/info 2023-02-15 23:01:46,088 DEBUG [StoreOpener-e8c9a9c8d7f85372b33b812768a5294e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/namespace/e8c9a9c8d7f85372b33b812768a5294e/info 2023-02-15 23:01:46,088 INFO [StoreOpener-e8c9a9c8d7f85372b33b812768a5294e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8c9a9c8d7f85372b33b812768a5294e columnFamilyName info 2023-02-15 23:01:46,089 INFO [StoreOpener-e8c9a9c8d7f85372b33b812768a5294e-1] regionserver.HStore(310): Store=e8c9a9c8d7f85372b33b812768a5294e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:46,089 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/namespace/e8c9a9c8d7f85372b33b812768a5294e 2023-02-15 23:01:46,090 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/namespace/e8c9a9c8d7f85372b33b812768a5294e 2023-02-15 23:01:46,092 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e8c9a9c8d7f85372b33b812768a5294e 2023-02-15 23:01:46,094 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/namespace/e8c9a9c8d7f85372b33b812768a5294e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:46,094 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e8c9a9c8d7f85372b33b812768a5294e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59284430, jitterRate=-0.11659315228462219}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:46,094 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e8c9a9c8d7f85372b33b812768a5294e: 2023-02-15 23:01:46,095 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e., pid=6, masterSystemTime=1676502106061 2023-02-15 23:01:46,098 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. 2023-02-15 23:01:46,099 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. 2023-02-15 23:01:46,099 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e8c9a9c8d7f85372b33b812768a5294e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:46,099 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502106099"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502106099"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502106099"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502106099"}]},"ts":"1676502106099"} 2023-02-15 23:01:46,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 23:01:46,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e8c9a9c8d7f85372b33b812768a5294e, server=jenkins-hbase4.apache.org,34933,1676502105087 in 192 msec 2023-02-15 23:01:46,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 23:01:46,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e8c9a9c8d7f85372b33b812768a5294e, ASSIGN in 348 msec 2023-02-15 23:01:46,103 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:46,103 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502106103"}]},"ts":"1676502106103"} 2023-02-15 23:01:46,104 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 23:01:46,107 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:46,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 384 msec 2023-02-15 23:01:46,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 23:01:46,126 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:46,126 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:46,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:46,129 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46972, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:46,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 23:01:46,137 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:46,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-15 23:01:46,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 23:01:46,148 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:46,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-15 23:01:46,156 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 23:01:46,158 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 23:01:46,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.015sec 2023-02-15 23:01:46,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 23:01:46,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 23:01:46,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 23:01:46,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46037,1676502105037-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 23:01:46,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46037,1676502105037-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 23:01:46,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 23:01:46,234 DEBUG [Listener at localhost/34643] zookeeper.ReadOnlyZKClient(139): Connect 0x13c85168 to 127.0.0.1:53274 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:46,237 DEBUG [Listener at localhost/34643] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fea0fad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:46,238 DEBUG [hconnection-0x541e2260-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:46,240 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59822, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:46,241 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46037,1676502105037 2023-02-15 23:01:46,241 DEBUG [Listener at localhost/34643] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 23:01:46,244 DEBUG [Listener at localhost/34643] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 23:01:46,245 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 23:01:46,246 INFO [Listener at localhost/34643] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:46,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:46,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 23:01:46,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 105 connection: 172.31.14.131:55162 deadline: 1676502166246, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:46,247 INFO [Listener at localhost/34643] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 23:01:46,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:46,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:46,251 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:46,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-15 23:01:46,252 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:46,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:46,253 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:46,253 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9 empty. 2023-02-15 23:01:46,254 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:46,254 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-15 23:01:46,261 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:46,262 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => acbfa1a8c7eb5a5752002dbdc98a6ee9, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp 2023-02-15 23:01:46,268 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:46,268 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing acbfa1a8c7eb5a5752002dbdc98a6ee9, disabling compactions & flushes 2023-02-15 23:01:46,268 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:46,268 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:46,268 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. after waiting 0 ms 2023-02-15 23:01:46,268 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:46,268 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:46,268 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for acbfa1a8c7eb5a5752002dbdc98a6ee9: 2023-02-15 23:01:46,270 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:46,271 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676502106271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502106271"}]},"ts":"1676502106271"} 2023-02-15 23:01:46,272 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 23:01:46,273 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:46,273 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502106273"}]},"ts":"1676502106273"} 2023-02-15 23:01:46,274 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-15 23:01:46,277 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:46,278 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:46,278 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:46,278 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:46,279 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=acbfa1a8c7eb5a5752002dbdc98a6ee9, ASSIGN}] 2023-02-15 23:01:46,280 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=acbfa1a8c7eb5a5752002dbdc98a6ee9, ASSIGN 2023-02-15 23:01:46,281 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=acbfa1a8c7eb5a5752002dbdc98a6ee9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34933,1676502105087; forceNewPlan=false, retain=false 2023-02-15 23:01:46,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:46,417 INFO [RS:1;jenkins-hbase4:41289] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41289%2C1676502105114, suffix=, logDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/WALs/jenkins-hbase4.apache.org,41289,1676502105114, archiveDir=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/oldWALs, maxLogs=32 2023-02-15 23:01:46,429 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43665,DS-9e1386e9-6756-4fb8-9f44-4ff5edafd265,DISK] 2023-02-15 23:01:46,429 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44239,DS-e8ddcba8-a824-4ccf-bda4-b43c98bfe9b5,DISK] 2023-02-15 23:01:46,431 INFO [RS:1;jenkins-hbase4:41289] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/WALs/jenkins-hbase4.apache.org,41289,1676502105114/jenkins-hbase4.apache.org%2C41289%2C1676502105114.1676502106417 2023-02-15 23:01:46,431 INFO [jenkins-hbase4:46037] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 23:01:46,431 DEBUG [RS:1;jenkins-hbase4:41289] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43665,DS-9e1386e9-6756-4fb8-9f44-4ff5edafd265,DISK], DatanodeInfoWithStorage[127.0.0.1:44239,DS-e8ddcba8-a824-4ccf-bda4-b43c98bfe9b5,DISK]] 2023-02-15 23:01:46,431 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=acbfa1a8c7eb5a5752002dbdc98a6ee9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:46,432 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676502106431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502106431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502106431"}]},"ts":"1676502106431"} 2023-02-15 23:01:46,433 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure acbfa1a8c7eb5a5752002dbdc98a6ee9, server=jenkins-hbase4.apache.org,34933,1676502105087}] 2023-02-15 23:01:46,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:46,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:46,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => acbfa1a8c7eb5a5752002dbdc98a6ee9, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:46,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:46,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:46,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:46,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:46,589 INFO [StoreOpener-acbfa1a8c7eb5a5752002dbdc98a6ee9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:46,590 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 23:01:46,590 DEBUG [StoreOpener-acbfa1a8c7eb5a5752002dbdc98a6ee9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1 2023-02-15 23:01:46,590 DEBUG [StoreOpener-acbfa1a8c7eb5a5752002dbdc98a6ee9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1 2023-02-15 23:01:46,590 INFO [StoreOpener-acbfa1a8c7eb5a5752002dbdc98a6ee9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acbfa1a8c7eb5a5752002dbdc98a6ee9 columnFamilyName f1 2023-02-15 23:01:46,592 INFO [StoreOpener-acbfa1a8c7eb5a5752002dbdc98a6ee9-1] regionserver.HStore(310): Store=acbfa1a8c7eb5a5752002dbdc98a6ee9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:46,593 INFO [StoreOpener-acbfa1a8c7eb5a5752002dbdc98a6ee9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:46,594 DEBUG [StoreOpener-acbfa1a8c7eb5a5752002dbdc98a6ee9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2 2023-02-15 23:01:46,594 DEBUG [StoreOpener-acbfa1a8c7eb5a5752002dbdc98a6ee9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2 2023-02-15 23:01:46,594 INFO [StoreOpener-acbfa1a8c7eb5a5752002dbdc98a6ee9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acbfa1a8c7eb5a5752002dbdc98a6ee9 columnFamilyName f2 2023-02-15 23:01:46,596 INFO [StoreOpener-acbfa1a8c7eb5a5752002dbdc98a6ee9-1] regionserver.HStore(310): Store=acbfa1a8c7eb5a5752002dbdc98a6ee9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:46,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:46,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:46,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:46,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:46,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:46,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened acbfa1a8c7eb5a5752002dbdc98a6ee9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70113072, jitterRate=0.04476618766784668}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:46,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for acbfa1a8c7eb5a5752002dbdc98a6ee9: 2023-02-15 23:01:46,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9., pid=12, masterSystemTime=1676502106584 2023-02-15 23:01:46,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:46,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:46,617 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=acbfa1a8c7eb5a5752002dbdc98a6ee9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:46,617 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676502106617"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502106617"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502106617"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502106617"}]},"ts":"1676502106617"} 2023-02-15 23:01:46,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 23:01:46,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure acbfa1a8c7eb5a5752002dbdc98a6ee9, server=jenkins-hbase4.apache.org,34933,1676502105087 in 185 msec 2023-02-15 23:01:46,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 23:01:46,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=acbfa1a8c7eb5a5752002dbdc98a6ee9, ASSIGN in 341 msec 2023-02-15 23:01:46,622 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:46,622 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502106622"}]},"ts":"1676502106622"} 2023-02-15 23:01:46,625 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-15 23:01:46,627 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:46,628 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 378 msec 2023-02-15 23:01:46,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:46,856 INFO [Listener at localhost/34643] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-15 23:01:46,856 DEBUG [Listener at localhost/34643] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-15 23:01:46,856 INFO [Listener at localhost/34643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:46,858 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-15 23:01:46,858 INFO [Listener at localhost/34643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:46,858 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-15 23:01:46,858 INFO [Listener at localhost/34643] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 23:01:46,870 DEBUG [hconnection-0x541e2260-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:46,882 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46980, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:46,893 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34933] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:46,981 INFO [Listener at localhost/34643] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 23:01:46,981 INFO [Listener at localhost/34643] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 23:01:46,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-15 23:01:46,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676502106982 (current time:1676502106982). 2023-02-15 23:01:46,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 23:01:46,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] zookeeper.ReadOnlyZKClient(139): Connect 0x43d6292c to 127.0.0.1:53274 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:46,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16fb2bb2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:46,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:46,988 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59836, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:46,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43d6292c to 127.0.0.1:53274 2023-02-15 23:01:46,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:46,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 23:01:46,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-15 23:01:46,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-15 23:01:46,992 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-15 23:01:46,993 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676502706993 2023-02-15 23:01:46,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-15 23:01:46,993 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:46,995 DEBUG [Listener at localhost/34643] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:46,996 DEBUG [Listener at localhost/34643] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 23:01:46,995 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-15 23:01:46,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-15 23:01:46,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 6 msec 2023-02-15 23:01:46,997 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-15 23:01:46,997 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676502706997 2023-02-15 23:01:47,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-15 23:01:47,005 INFO [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-15 23:01:47,005 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:47,006 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-15 23:01:47,006 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-15 23:01:47,006 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,006 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-15 23:01:47,009 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:47,009 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:47,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:47,009 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:47,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:47,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:47,009 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,009 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:47,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 23:01:47,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 23:01:47,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-15 23:01:47,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 23:01:47,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-15 23:01:47,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 23:01:47,010 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-15 23:01:47,010 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-15 23:01:47,010 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 23:01:47,010 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 23:01:47,010 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 23:01:47,010 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:47,010 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 23:01:47,011 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:47,011 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 23:01:47,012 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 23:01:47,012 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 23:01:47,012 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 23:01:47,012 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34933,1676502105087' joining acquired barrier for procedure (foo) in zk 2023-02-15 23:01:47,012 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41289,1676502105114' joining acquired barrier for procedure (foo) in zk 2023-02-15 23:01:47,013 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,013 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:47,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:47,014 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:47,014 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 23:01:47,014 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:47,014 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 23:01:47,014 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 23:01:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:47,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34933,1676502105087' joining acquired barrier for procedure 'foo' on coordinator 2023-02-15 23:01:47,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@93a5981[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:47,015 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-15 23:01:47,016 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:47,017 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 23:01:47,017 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 23:01:47,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:47,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:47,017 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 23:01:47,017 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,017 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 23:01:47,017 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 23:01:47,017 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 23:01:47,017 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:47,017 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 23:01:47,017 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. started... 2023-02-15 23:01:47,017 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 23:01:47,017 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,41289,1676502105114' in zk 2023-02-15 23:01:47,017 INFO [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] regionserver.HRegion(2744): Flushing acbfa1a8c7eb5a5752002dbdc98a6ee9 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 23:01:47,024 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 23:01:47,024 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:47,024 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 23:01:47,032 INFO [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/.tmp/f1/d460062963f342939304639f3a69006b 2023-02-15 23:01:47,048 INFO [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/.tmp/f2/f2abf424c7fe4dda9540fccabc41d124 2023-02-15 23:01:47,052 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/.tmp/f1/d460062963f342939304639f3a69006b as hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1/d460062963f342939304639f3a69006b 2023-02-15 23:01:47,056 INFO [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1/d460062963f342939304639f3a69006b, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 23:01:47,057 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/.tmp/f2/f2abf424c7fe4dda9540fccabc41d124 as hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2/f2abf424c7fe4dda9540fccabc41d124 2023-02-15 23:01:47,060 INFO [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2/f2abf424c7fe4dda9540fccabc41d124, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 23:01:47,061 INFO [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for acbfa1a8c7eb5a5752002dbdc98a6ee9 in 44ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:47,061 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 23:01:47,061 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for acbfa1a8c7eb5a5752002dbdc98a6ee9: 2023-02-15 23:01:47,062 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.' region-info for snapshot=foo 2023-02-15 23:01:47,062 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:47,062 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1/d460062963f342939304639f3a69006b] hfiles 2023-02-15 23:01:47,062 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1/d460062963f342939304639f3a69006b for snapshot=foo 2023-02-15 23:01:47,062 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2/f2abf424c7fe4dda9540fccabc41d124] hfiles 2023-02-15 23:01:47,062 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2/f2abf424c7fe4dda9540fccabc41d124 for snapshot=foo 2023-02-15 23:01:47,071 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. completed. 2023-02-15 23:01:47,071 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 23:01:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 23:01:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 23:01:47,071 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34933,1676502105087' in zk 2023-02-15 23:01:47,073 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 23:01:47,073 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,073 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:47,073 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 23:01:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 23:01:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 23:01:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,34933,1676502105087': 2023-02-15 23:01:47,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34933,1676502105087' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-15 23:01:47,076 INFO [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-15 23:01:47,076 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:47,076 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:47,076 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-15 23:01:47,076 INFO [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 23:01:47,078 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,078 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,078 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:47,078 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:47,078 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:47,078 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:47,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:47,079 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 23:01:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:47,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 23:01:47,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,080 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,080 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:47,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 23:01:47,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,087 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:47,087 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:47,087 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,087 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:47,087 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-15 23:01:47,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:47,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-15 23:01:47,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:47,087 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:47,087 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:47,087 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 23:01:47,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:47,087 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,087 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 23:01:47,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:47,087 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.hbase-snapshot/.tmp/foo 2023-02-15 23:01:47,088 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 23:01:47,088 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,088 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 23:01:47,088 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 23:01:47,096 DEBUG [Listener at localhost/34643] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:47,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-15 23:01:47,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-15 23:01:47,097 DEBUG [Listener at localhost/34643] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 23:01:47,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.hbase-snapshot/.tmp/foo to hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.hbase-snapshot/foo 2023-02-15 23:01:47,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-15 23:01:47,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.hbase-snapshot/.tmp/foo 2023-02-15 23:01:47,123 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.hbase-snapshot/.tmp/foo 2023-02-15 23:01:47,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676502106993Consolidate snapshot: foo at 1676502107087 (+94 ms)Loading Region manifests for foo at 1676502107087Writing data manifest for foo at 1676502107091 (+4 ms)Verifying snapshot: foo at 1676502107099 (+8 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676502107123 (+24 ms) 2023-02-15 23:01:47,125 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-15 23:01:47,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 131 msec 2023-02-15 23:01:47,297 DEBUG [Listener at localhost/34643] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:47,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-15 23:01:47,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 23:01:47,299 INFO [Listener at localhost/34643] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 23:01:47,302 INFO [Listener at localhost/34643] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 23:01:47,306 INFO [Listener at localhost/34643] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 23:01:47,339 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34933] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:47,421 INFO [Listener at localhost/34643] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 23:01:47,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 23:01:47,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,428 INFO [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 23:01:47,428 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:47,429 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-15 23:01:47,429 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-15 23:01:47,430 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,430 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,431 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:47,431 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:47,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:47,431 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:47,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:47,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:47,431 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,431 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:47,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:47,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:47,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,432 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,432 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,432 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-15 23:01:47,432 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:47,433 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-15 23:01:47,433 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-15 23:01:47,433 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:47,433 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 23:01:47,434 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 23:01:47,434 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:47,434 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. started... 2023-02-15 23:01:47,434 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-15 23:01:47,434 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-15 23:01:47,434 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41289,1676502105114' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-15 23:01:47,434 INFO [rs(jenkins-hbase4.apache.org,34933,1676502105087)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing acbfa1a8c7eb5a5752002dbdc98a6ee9 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 23:01:47,436 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,436 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,436 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:47,450 INFO [rs(jenkins-hbase4.apache.org,34933,1676502105087)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/.tmp/f1/2bbd9303bd574acc95e59aca2a2e1705 2023-02-15 23:01:47,469 INFO [rs(jenkins-hbase4.apache.org,34933,1676502105087)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/.tmp/f2/a7bfe4bc6f9a4ce6bead8786ace29ea5 2023-02-15 23:01:47,473 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/.tmp/f1/2bbd9303bd574acc95e59aca2a2e1705 as hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1/2bbd9303bd574acc95e59aca2a2e1705 2023-02-15 23:01:47,476 INFO [rs(jenkins-hbase4.apache.org,34933,1676502105087)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1/2bbd9303bd574acc95e59aca2a2e1705, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 23:01:47,477 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/.tmp/f2/a7bfe4bc6f9a4ce6bead8786ace29ea5 as hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2/a7bfe4bc6f9a4ce6bead8786ace29ea5 2023-02-15 23:01:47,481 INFO [rs(jenkins-hbase4.apache.org,34933,1676502105087)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2/a7bfe4bc6f9a4ce6bead8786ace29ea5, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 23:01:47,481 INFO [rs(jenkins-hbase4.apache.org,34933,1676502105087)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for acbfa1a8c7eb5a5752002dbdc98a6ee9 in 47ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:47,482 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for acbfa1a8c7eb5a5752002dbdc98a6ee9: 2023-02-15 23:01:47,482 DEBUG [rs(jenkins-hbase4.apache.org,34933,1676502105087)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:47,482 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 23:01:47,482 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 23:01:47,482 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,483 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-15 23:01:47,483 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34933,1676502105087' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-15 23:01:47,484 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,484 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:47,484 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,484 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:47,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34933,1676502105087' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-15 23:01:47,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d05cc7e[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:47,486 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-15 23:01:47,486 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,488 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,488 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,488 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,488 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-15 23:01:47,489 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-15 23:01:47,488 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:47,489 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-15 23:01:47,489 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-15 23:01:47,489 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,41289,1676502105114' in zk 2023-02-15 23:01:47,489 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,34933,1676502105087' in zk 2023-02-15 23:01:47,490 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-15 23:01:47,490 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,490 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:47,490 DEBUG [member: 'jenkins-hbase4.apache.org,34933,1676502105087' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-15 23:01:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:47,491 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-15 23:01:47,491 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:47,491 DEBUG [member: 'jenkins-hbase4.apache.org,41289,1676502105114' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-15 23:01:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,34933,1676502105087': 2023-02-15 23:01:47,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34933,1676502105087' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-15 23:01:47,493 INFO [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-15 23:01:47,493 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:47,493 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:47,493 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,493 INFO [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 23:01:47,495 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,495 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,495 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,495 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:47,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:47,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:47,495 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:47,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:47,495 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:47,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:47,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:47,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:47,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,496 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:47,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,497 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,498 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,501 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,501 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:47,501 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:47,502 DEBUG [(jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:47,502 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:47,501 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:47,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 23:01:47,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 23:01:47,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:47,502 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:47,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:47,502 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:47,502 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,502 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:47,502 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,502 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,502 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,502 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,502 DEBUG [Listener at localhost/34643] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:47,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:47,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:47,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:47,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:47,502 DEBUG [Listener at localhost/34643] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 23:01:47,603 DEBUG [Listener at localhost/34643] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 23:01:47,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 23:01:47,608 INFO [Listener at localhost/34643] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676502106982 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:47,608 DEBUG [Listener at localhost/34643] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46623/user/jenkins/test-data/23c7bbc1-5c7e-69b6-c9e3-db5f47d96ac1/foo/619691bd-4f15-4d40-b6c0-8c7a04143dcc/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,608 INFO [Listener at localhost/34643] snapshot.RestoreSnapshotHelper(239): region to add: acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:47,608 INFO [Listener at localhost/34643] snapshot.RestoreSnapshotHelper(585): clone region=acbfa1a8c7eb5a5752002dbdc98a6ee9 as acbfa1a8c7eb5a5752002dbdc98a6ee9 in snapshot foo 2023-02-15 23:01:47,609 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => acbfa1a8c7eb5a5752002dbdc98a6ee9, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46623/user/jenkins/test-data/23c7bbc1-5c7e-69b6-c9e3-db5f47d96ac1/foo/619691bd-4f15-4d40-b6c0-8c7a04143dcc 2023-02-15 23:01:47,618 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:47,618 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d460062963f342939304639f3a69006b from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,620 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f2abf424c7fe4dda9540fccabc41d124 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,621 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing acbfa1a8c7eb5a5752002dbdc98a6ee9, disabling compactions & flushes 2023-02-15 23:01:47,621 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:47,621 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:47,621 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. after waiting 0 ms 2023-02-15 23:01:47,621 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:47,622 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:47,622 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for acbfa1a8c7eb5a5752002dbdc98a6ee9: 2023-02-15 23:01:47,623 INFO [Listener at localhost/34643] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676502106982 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:47,623 DEBUG [Listener at localhost/34643] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46623/user/jenkins/test-data/23c7bbc1-5c7e-69b6-c9e3-db5f47d96ac1/foo/619691bd-4f15-4d40-b6c0-8c7a04143dcc 2023-02-15 23:01:47,623 DEBUG [Listener at localhost/34643] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46623/user/jenkins/test-data/23c7bbc1-5c7e-69b6-c9e3-db5f47d96ac1/foo/619691bd-4f15-4d40-b6c0-8c7a04143dcc 2023-02-15 23:01:47,624 DEBUG [Listener at localhost/34643] util.CommonFSUtils(699): |-data/ 2023-02-15 23:01:47,624 DEBUG [Listener at localhost/34643] util.CommonFSUtils(699): |----default/ 2023-02-15 23:01:47,624 DEBUG [Listener at localhost/34643] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-15 23:01:47,625 DEBUG [Listener at localhost/34643] util.CommonFSUtils(699): |----------acbfa1a8c7eb5a5752002dbdc98a6ee9/ 2023-02-15 23:01:47,625 DEBUG [Listener at localhost/34643] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:47,625 DEBUG [Listener at localhost/34643] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:47,625 DEBUG [Listener at localhost/34643] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=acbfa1a8c7eb5a5752002dbdc98a6ee9-d460062963f342939304639f3a69006b 2023-02-15 23:01:47,625 DEBUG [Listener at localhost/34643] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:47,626 DEBUG [Listener at localhost/34643] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=acbfa1a8c7eb5a5752002dbdc98a6ee9-f2abf424c7fe4dda9540fccabc41d124 hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1/2bbd9303bd574acc95e59aca2a2e1705 hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1/d460062963f342939304639f3a69006b hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2/a7bfe4bc6f9a4ce6bead8786ace29ea5 hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2/f2abf424c7fe4dda9540fccabc41d124 2023-02-15 23:01:47,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-15 23:01:47,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-15 23:01:47,634 INFO [Listener at localhost/34643] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 23:01:47,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502107638"}]},"ts":"1676502107638"} 2023-02-15 23:01:47,639 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-15 23:01:47,641 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-15 23:01:47,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=acbfa1a8c7eb5a5752002dbdc98a6ee9, UNASSIGN}] 2023-02-15 23:01:47,643 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=acbfa1a8c7eb5a5752002dbdc98a6ee9, UNASSIGN 2023-02-15 23:01:47,645 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=acbfa1a8c7eb5a5752002dbdc98a6ee9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:47,645 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676502107645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502107645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502107645"}]},"ts":"1676502107645"} 2023-02-15 23:01:47,647 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure acbfa1a8c7eb5a5752002dbdc98a6ee9, server=jenkins-hbase4.apache.org,34933,1676502105087}] 2023-02-15 23:01:47,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 23:01:47,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:47,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing acbfa1a8c7eb5a5752002dbdc98a6ee9, disabling compactions & flushes 2023-02-15 23:01:47,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:47,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:47,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. after waiting 0 ms 2023-02-15 23:01:47,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:47,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:47,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9. 2023-02-15 23:01:47,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for acbfa1a8c7eb5a5752002dbdc98a6ee9: 2023-02-15 23:01:47,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:47,806 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=acbfa1a8c7eb5a5752002dbdc98a6ee9, regionState=CLOSED 2023-02-15 23:01:47,806 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676502107806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502107806"}]},"ts":"1676502107806"} 2023-02-15 23:01:47,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 23:01:47,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure acbfa1a8c7eb5a5752002dbdc98a6ee9, server=jenkins-hbase4.apache.org,34933,1676502105087 in 161 msec 2023-02-15 23:01:47,809 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 23:01:47,809 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=acbfa1a8c7eb5a5752002dbdc98a6ee9, UNASSIGN in 166 msec 2023-02-15 23:01:47,810 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502107810"}]},"ts":"1676502107810"} 2023-02-15 23:01:47,811 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-15 23:01:47,812 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-15 23:01:47,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 179 msec 2023-02-15 23:01:47,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 23:01:47,941 INFO [Listener at localhost/34643] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-15 23:01:47,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,944 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,944 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 23:01:47,947 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:47,948 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1, FileablePath, hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2, FileablePath, hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/recovered.edits] 2023-02-15 23:01:47,951 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1/2bbd9303bd574acc95e59aca2a2e1705 to hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1/2bbd9303bd574acc95e59aca2a2e1705 2023-02-15 23:01:47,952 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1/d460062963f342939304639f3a69006b to hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f1/d460062963f342939304639f3a69006b 2023-02-15 23:01:47,954 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2/a7bfe4bc6f9a4ce6bead8786ace29ea5 to hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2/a7bfe4bc6f9a4ce6bead8786ace29ea5 2023-02-15 23:01:47,955 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2/f2abf424c7fe4dda9540fccabc41d124 to hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/f2/f2abf424c7fe4dda9540fccabc41d124 2023-02-15 23:01:47,957 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/recovered.edits/12.seqid to hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9/recovered.edits/12.seqid 2023-02-15 23:01:47,957 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/acbfa1a8c7eb5a5752002dbdc98a6ee9 2023-02-15 23:01:47,957 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-15 23:01:47,959 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,960 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-15 23:01:47,962 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-15 23:01:47,965 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,965 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-15 23:01:47,965 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502107965"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:47,966 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 23:01:47,966 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => acbfa1a8c7eb5a5752002dbdc98a6ee9, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676502106249.acbfa1a8c7eb5a5752002dbdc98a6ee9.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 23:01:47,966 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-15 23:01:47,966 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676502107966"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:47,967 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-15 23:01:47,969 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 23:01:47,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 28 msec 2023-02-15 23:01:48,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 23:01:48,046 INFO [Listener at localhost/34643] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-15 23:01:48,046 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 23:01:48,046 INFO [Listener at localhost/34643] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 23:01:48,046 DEBUG [Listener at localhost/34643] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13c85168 to 127.0.0.1:53274 2023-02-15 23:01:48,047 DEBUG [Listener at localhost/34643] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:48,047 DEBUG [Listener at localhost/34643] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 23:01:48,047 DEBUG [Listener at localhost/34643] util.JVMClusterUtil(257): Found active master hash=1720089057, stopped=false 2023-02-15 23:01:48,047 INFO [Listener at localhost/34643] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46037,1676502105037 2023-02-15 23:01:48,050 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:48,050 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:48,050 INFO [Listener at localhost/34643] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 23:01:48,050 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:48,050 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:48,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:48,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:48,051 DEBUG [Listener at localhost/34643] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d96c30d to 127.0.0.1:53274 2023-02-15 23:01:48,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:48,052 DEBUG [Listener at localhost/34643] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:48,052 INFO [Listener at localhost/34643] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34933,1676502105087' ***** 2023-02-15 23:01:48,052 INFO [Listener at localhost/34643] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:48,052 INFO [Listener at localhost/34643] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41289,1676502105114' ***** 2023-02-15 23:01:48,052 INFO [Listener at localhost/34643] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:48,052 INFO [RS:0;jenkins-hbase4:34933] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:48,052 INFO [RS:1;jenkins-hbase4:41289] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:48,052 INFO [RS:0;jenkins-hbase4:34933] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:48,052 INFO [RS:1;jenkins-hbase4:41289] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:48,052 INFO [RS:0;jenkins-hbase4:34933] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:48,053 INFO [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(3304): Received CLOSE for e8c9a9c8d7f85372b33b812768a5294e 2023-02-15 23:01:48,053 INFO [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:48,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e8c9a9c8d7f85372b33b812768a5294e, disabling compactions & flushes 2023-02-15 23:01:48,052 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:48,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. 2023-02-15 23:01:48,053 DEBUG [RS:0;jenkins-hbase4:34933] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e6c8576 to 127.0.0.1:53274 2023-02-15 23:01:48,053 INFO [RS:1;jenkins-hbase4:41289] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:48,053 DEBUG [RS:0;jenkins-hbase4:34933] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:48,054 INFO [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:48,053 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:48,054 DEBUG [RS:1;jenkins-hbase4:41289] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0344a73d to 127.0.0.1:53274 2023-02-15 23:01:48,054 INFO [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 23:01:48,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. 2023-02-15 23:01:48,055 DEBUG [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(1479): Online Regions={e8c9a9c8d7f85372b33b812768a5294e=hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e.} 2023-02-15 23:01:48,055 DEBUG [RS:1;jenkins-hbase4:41289] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:48,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. after waiting 0 ms 2023-02-15 23:01:48,055 DEBUG [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(1505): Waiting on e8c9a9c8d7f85372b33b812768a5294e 2023-02-15 23:01:48,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. 2023-02-15 23:01:48,055 INFO [RS:1;jenkins-hbase4:41289] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:48,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e8c9a9c8d7f85372b33b812768a5294e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 23:01:48,055 INFO [RS:1;jenkins-hbase4:41289] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:48,055 INFO [RS:1;jenkins-hbase4:41289] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:48,055 INFO [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 23:01:48,056 INFO [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 23:01:48,056 DEBUG [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-15 23:01:48,056 DEBUG [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 23:01:48,056 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:48,056 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:48,056 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:48,056 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:48,056 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:48,056 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-15 23:01:48,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/namespace/e8c9a9c8d7f85372b33b812768a5294e/.tmp/info/8f332618598747fcb02ace5acee5378f 2023-02-15 23:01:48,067 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/.tmp/info/ab6f5dea696947e1a37d1f05fd6de48d 2023-02-15 23:01:48,070 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab6f5dea696947e1a37d1f05fd6de48d 2023-02-15 23:01:48,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/namespace/e8c9a9c8d7f85372b33b812768a5294e/.tmp/info/8f332618598747fcb02ace5acee5378f as hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/namespace/e8c9a9c8d7f85372b33b812768a5294e/info/8f332618598747fcb02ace5acee5378f 2023-02-15 23:01:48,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/namespace/e8c9a9c8d7f85372b33b812768a5294e/info/8f332618598747fcb02ace5acee5378f, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 23:01:48,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e8c9a9c8d7f85372b33b812768a5294e in 20ms, sequenceid=6, compaction requested=false 2023-02-15 23:01:48,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/.tmp/rep_barrier/22f184b7d19c416da5bb8a0fbc23e94c 2023-02-15 23:01:48,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/namespace/e8c9a9c8d7f85372b33b812768a5294e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 23:01:48,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. 2023-02-15 23:01:48,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e8c9a9c8d7f85372b33b812768a5294e: 2023-02-15 23:01:48,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676502105723.e8c9a9c8d7f85372b33b812768a5294e. 2023-02-15 23:01:48,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22f184b7d19c416da5bb8a0fbc23e94c 2023-02-15 23:01:48,087 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:48,089 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/.tmp/table/f3a205af42f1402a9d4d891de3c1d8df 2023-02-15 23:01:48,092 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:48,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3a205af42f1402a9d4d891de3c1d8df 2023-02-15 23:01:48,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/.tmp/info/ab6f5dea696947e1a37d1f05fd6de48d as hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/info/ab6f5dea696947e1a37d1f05fd6de48d 2023-02-15 23:01:48,097 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab6f5dea696947e1a37d1f05fd6de48d 2023-02-15 23:01:48,097 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/info/ab6f5dea696947e1a37d1f05fd6de48d, entries=12, sequenceid=21, filesize=6.3 K 2023-02-15 23:01:48,098 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/.tmp/rep_barrier/22f184b7d19c416da5bb8a0fbc23e94c as hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/rep_barrier/22f184b7d19c416da5bb8a0fbc23e94c 2023-02-15 23:01:48,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22f184b7d19c416da5bb8a0fbc23e94c 2023-02-15 23:01:48,101 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/rep_barrier/22f184b7d19c416da5bb8a0fbc23e94c, entries=1, sequenceid=21, filesize=5.1 K 2023-02-15 23:01:48,101 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/.tmp/table/f3a205af42f1402a9d4d891de3c1d8df as hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/table/f3a205af42f1402a9d4d891de3c1d8df 2023-02-15 23:01:48,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3a205af42f1402a9d4d891de3c1d8df 2023-02-15 23:01:48,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/table/f3a205af42f1402a9d4d891de3c1d8df, entries=4, sequenceid=21, filesize=5.1 K 2023-02-15 23:01:48,105 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false 2023-02-15 23:01:48,108 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 23:01:48,109 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 23:01:48,109 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:48,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:48,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:48,255 INFO [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34933,1676502105087; all regions closed. 2023-02-15 23:01:48,256 INFO [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41289,1676502105114; all regions closed. 2023-02-15 23:01:48,258 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/WALs/jenkins-hbase4.apache.org,41289,1676502105114/jenkins-hbase4.apache.org%2C41289%2C1676502105114.meta.1676502105666.meta not finished, retry = 0 2023-02-15 23:01:48,260 DEBUG [RS:0;jenkins-hbase4:34933] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/oldWALs 2023-02-15 23:01:48,260 INFO [RS:0;jenkins-hbase4:34933] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34933%2C1676502105087:(num 1676502106068) 2023-02-15 23:01:48,260 DEBUG [RS:0;jenkins-hbase4:34933] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:48,260 INFO [RS:0;jenkins-hbase4:34933] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:48,260 INFO [RS:0;jenkins-hbase4:34933] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:48,260 INFO [RS:0;jenkins-hbase4:34933] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:48,260 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:48,260 INFO [RS:0;jenkins-hbase4:34933] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:48,261 INFO [RS:0;jenkins-hbase4:34933] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:48,262 INFO [RS:0;jenkins-hbase4:34933] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34933 2023-02-15 23:01:48,263 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:48,263 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:48,263 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:48,263 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34933,1676502105087 2023-02-15 23:01:48,263 ERROR [Listener at localhost/34643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@794ebce2 rejected from java.util.concurrent.ThreadPoolExecutor@7d713713[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:48,264 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:48,264 ERROR [Listener at localhost/34643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a49ff0 rejected from java.util.concurrent.ThreadPoolExecutor@7d713713[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:48,264 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34933,1676502105087] 2023-02-15 23:01:48,264 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34933,1676502105087; numProcessing=1 2023-02-15 23:01:48,266 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34933,1676502105087 already deleted, retry=false 2023-02-15 23:01:48,266 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34933,1676502105087 expired; onlineServers=1 2023-02-15 23:01:48,360 DEBUG [RS:1;jenkins-hbase4:41289] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/oldWALs 2023-02-15 23:01:48,360 INFO [RS:1;jenkins-hbase4:41289] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41289%2C1676502105114.meta:.meta(num 1676502105666) 2023-02-15 23:01:48,364 DEBUG [RS:1;jenkins-hbase4:41289] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/oldWALs 2023-02-15 23:01:48,364 INFO [RS:1;jenkins-hbase4:41289] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41289%2C1676502105114:(num 1676502106417) 2023-02-15 23:01:48,364 DEBUG [RS:1;jenkins-hbase4:41289] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:48,364 INFO [RS:1;jenkins-hbase4:41289] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:48,364 INFO [RS:1;jenkins-hbase4:41289] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:48,364 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:48,365 INFO [RS:1;jenkins-hbase4:41289] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41289 2023-02-15 23:01:48,367 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:48,367 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41289,1676502105114 2023-02-15 23:01:48,368 ERROR [Listener at localhost/34643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@517a5afa rejected from java.util.concurrent.ThreadPoolExecutor@5545d40d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:48,368 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41289,1676502105114] 2023-02-15 23:01:48,369 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41289,1676502105114; numProcessing=2 2023-02-15 23:01:48,370 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41289,1676502105114 already deleted, retry=false 2023-02-15 23:01:48,370 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41289,1676502105114 expired; onlineServers=0 2023-02-15 23:01:48,370 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46037,1676502105037' ***** 2023-02-15 23:01:48,370 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 23:01:48,371 DEBUG [M:0;jenkins-hbase4:46037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62b9e1e9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:48,371 INFO [M:0;jenkins-hbase4:46037] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46037,1676502105037 2023-02-15 23:01:48,371 INFO [M:0;jenkins-hbase4:46037] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46037,1676502105037; all regions closed. 2023-02-15 23:01:48,371 DEBUG [M:0;jenkins-hbase4:46037] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:48,371 DEBUG [M:0;jenkins-hbase4:46037] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 23:01:48,371 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 23:01:48,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502105263] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502105263,5,FailOnTimeoutGroup] 2023-02-15 23:01:48,371 DEBUG [M:0;jenkins-hbase4:46037] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 23:01:48,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502105264] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502105264,5,FailOnTimeoutGroup] 2023-02-15 23:01:48,372 INFO [M:0;jenkins-hbase4:46037] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 23:01:48,372 INFO [M:0;jenkins-hbase4:46037] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 23:01:48,372 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:48,372 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:48,372 INFO [M:0;jenkins-hbase4:46037] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 23:01:48,372 DEBUG [M:0;jenkins-hbase4:46037] master.HMaster(1512): Stopping service threads 2023-02-15 23:01:48,372 INFO [M:0;jenkins-hbase4:46037] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 23:01:48,373 ERROR [M:0;jenkins-hbase4:46037] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 23:01:48,373 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:48,373 INFO [M:0;jenkins-hbase4:46037] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 23:01:48,373 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 23:01:48,373 DEBUG [M:0;jenkins-hbase4:46037] zookeeper.ZKUtil(398): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 23:01:48,373 WARN [M:0;jenkins-hbase4:46037] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 23:01:48,373 INFO [M:0;jenkins-hbase4:46037] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 23:01:48,374 INFO [M:0;jenkins-hbase4:46037] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 23:01:48,374 DEBUG [M:0;jenkins-hbase4:46037] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:48,374 INFO [M:0;jenkins-hbase4:46037] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:48,374 DEBUG [M:0;jenkins-hbase4:46037] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:48,374 DEBUG [M:0;jenkins-hbase4:46037] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:48,374 DEBUG [M:0;jenkins-hbase4:46037] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:48,374 INFO [M:0;jenkins-hbase4:46037] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.68 KB heapSize=67.66 KB 2023-02-15 23:01:48,382 INFO [M:0;jenkins-hbase4:46037] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.68 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/248ca7ad90c545a5aeacec37081aaa26 2023-02-15 23:01:48,386 DEBUG [M:0;jenkins-hbase4:46037] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/248ca7ad90c545a5aeacec37081aaa26 as hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/248ca7ad90c545a5aeacec37081aaa26 2023-02-15 23:01:48,389 INFO [M:0;jenkins-hbase4:46037] regionserver.HStore(1080): Added hdfs://localhost:46623/user/jenkins/test-data/bb1615f3-4ff2-5cfb-badf-ee2bc0998f0c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/248ca7ad90c545a5aeacec37081aaa26, entries=17, sequenceid=132, filesize=8.7 K 2023-02-15 23:01:48,390 INFO [M:0;jenkins-hbase4:46037] regionserver.HRegion(2947): Finished flush of dataSize ~56.68 KB/58040, heapSize ~67.64 KB/69264, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-15 23:01:48,390 INFO [M:0;jenkins-hbase4:46037] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:48,390 DEBUG [M:0;jenkins-hbase4:46037] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:48,392 INFO [M:0;jenkins-hbase4:46037] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 23:01:48,392 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:48,393 INFO [M:0;jenkins-hbase4:46037] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46037 2023-02-15 23:01:48,395 DEBUG [M:0;jenkins-hbase4:46037] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46037,1676502105037 already deleted, retry=false 2023-02-15 23:01:48,551 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:48,551 INFO [M:0;jenkins-hbase4:46037] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46037,1676502105037; zookeeper connection closed. 2023-02-15 23:01:48,551 ERROR [Listener at localhost/34643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@212874e6 rejected from java.util.concurrent.ThreadPoolExecutor@2517e41b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:48,552 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): master:46037-0x1005a37e5780000, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:48,552 ERROR [Listener at localhost/34643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@33d22163 rejected from java.util.concurrent.ThreadPoolExecutor@2517e41b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:48,651 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:48,651 INFO [RS:1;jenkins-hbase4:41289] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41289,1676502105114; zookeeper connection closed. 2023-02-15 23:01:48,651 ERROR [Listener at localhost/34643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@223343e3 rejected from java.util.concurrent.ThreadPoolExecutor@5545d40d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:48,652 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:41289-0x1005a37e5780002, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:48,652 ERROR [Listener at localhost/34643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a832d47 rejected from java.util.concurrent.ThreadPoolExecutor@5545d40d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:48,652 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@64028b5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@64028b5 2023-02-15 23:01:48,752 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:48,752 INFO [RS:0;jenkins-hbase4:34933] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34933,1676502105087; zookeeper connection closed. 2023-02-15 23:01:48,752 ERROR [Listener at localhost/34643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d3cfd96 rejected from java.util.concurrent.ThreadPoolExecutor@7d713713[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:48,752 DEBUG [Listener at localhost/34643-EventThread] zookeeper.ZKWatcher(600): regionserver:34933-0x1005a37e5780001, quorum=127.0.0.1:53274, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:48,752 ERROR [Listener at localhost/34643-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@79a61672 rejected from java.util.concurrent.ThreadPoolExecutor@7d713713[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:48,752 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@99633dc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@99633dc 2023-02-15 23:01:48,752 INFO [Listener at localhost/34643] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 23:01:48,752 WARN [Listener at localhost/34643] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:48,756 INFO [Listener at localhost/34643] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:48,858 WARN [BP-1148731549-172.31.14.131-1676502104466 heartbeating to localhost/127.0.0.1:46623] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 23:01:48,858 WARN [BP-1148731549-172.31.14.131-1676502104466 heartbeating to localhost/127.0.0.1:46623] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1148731549-172.31.14.131-1676502104466 (Datanode Uuid 4d79103b-65ca-424d-bcf3-131c8d083650) service to localhost/127.0.0.1:46623 2023-02-15 23:01:48,860 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/cluster_229599b0-5278-ca1f-a737-44c4a03d3a26/dfs/data/data3/current/BP-1148731549-172.31.14.131-1676502104466] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:48,861 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/cluster_229599b0-5278-ca1f-a737-44c4a03d3a26/dfs/data/data4/current/BP-1148731549-172.31.14.131-1676502104466] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:48,862 WARN [Listener at localhost/34643] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:48,864 INFO [Listener at localhost/34643] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:48,969 WARN [BP-1148731549-172.31.14.131-1676502104466 heartbeating to localhost/127.0.0.1:46623] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 23:01:48,969 WARN [BP-1148731549-172.31.14.131-1676502104466 heartbeating to localhost/127.0.0.1:46623] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1148731549-172.31.14.131-1676502104466 (Datanode Uuid dbc5b284-101c-47ce-af17-f1561f331e5c) service to localhost/127.0.0.1:46623 2023-02-15 23:01:48,970 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/cluster_229599b0-5278-ca1f-a737-44c4a03d3a26/dfs/data/data1/current/BP-1148731549-172.31.14.131-1676502104466] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:48,970 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/cluster_229599b0-5278-ca1f-a737-44c4a03d3a26/dfs/data/data2/current/BP-1148731549-172.31.14.131-1676502104466] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:48,979 INFO [Listener at localhost/34643] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:49,091 INFO [Listener at localhost/34643] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 23:01:49,111 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 23:01:49,123 INFO [Listener at localhost/34643] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=273 (was 253) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:46623 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:46623 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:46623 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34643 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46623 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:46623 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46037,1676502105037)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:46623 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:46623 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=576 (was 660), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=333 (was 336), ProcessCount=166 (was 166), AvailableMemoryMB=2534 (was 2557) 2023-02-15 23:01:49,133 INFO [Listener at localhost/34643] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=273, OpenFileDescriptor=576, MaxFileDescriptor=60000, SystemLoadAverage=333, ProcessCount=166, AvailableMemoryMB=2534 2023-02-15 23:01:49,143 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/hadoop.log.dir so I do NOT create it in target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef 2023-02-15 23:01:49,143 WARN [Listener at localhost/34643] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 23:01:49,143 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/hadoop.tmp.dir so I do NOT create it in target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef 2023-02-15 23:01:49,143 WARN [Listener at localhost/34643] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1f4ffa04-bc85-9097-32dc-f6a3203d23db/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 23:01:49,143 DEBUG [Listener at localhost/34643] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef 2023-02-15 23:01:49,143 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 23:01:49,144 INFO [Listener at localhost/34643] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/cluster_e2fecff1-f66f-f2b8-63e8-80a828581726, deleteOnExit=true 2023-02-15 23:01:49,144 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 23:01:49,144 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/test.cache.data in system properties and HBase conf 2023-02-15 23:01:49,144 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 23:01:49,144 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/hadoop.log.dir in system properties and HBase conf 2023-02-15 23:01:49,144 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 23:01:49,144 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 23:01:49,144 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 23:01:49,144 DEBUG [Listener at localhost/34643] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 23:01:49,145 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:01:49,145 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 23:01:49,145 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 23:01:49,145 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:01:49,145 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 23:01:49,145 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 23:01:49,145 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 23:01:49,145 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:01:49,145 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 23:01:49,145 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/nfs.dump.dir in system properties and HBase conf 2023-02-15 23:01:49,145 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/java.io.tmpdir in system properties and HBase conf 2023-02-15 23:01:49,146 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 23:01:49,146 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 23:01:49,146 INFO [Listener at localhost/34643] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 23:01:49,150 WARN [Listener at localhost/34643] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:01:49,150 WARN [Listener at localhost/34643] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:01:49,191 WARN [Listener at localhost/34643] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:49,193 INFO [Listener at localhost/34643] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:49,196 INFO [Listener at localhost/34643] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/java.io.tmpdir/Jetty_localhost_41689_hdfs____.gnw3g/webapp 2023-02-15 23:01:49,288 INFO [Listener at localhost/34643] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41689 2023-02-15 23:01:49,292 WARN [Listener at localhost/34643] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 23:01:49,292 WARN [Listener at localhost/34643] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 23:01:49,338 WARN [Listener at localhost/46501] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:49,355 WARN [Listener at localhost/46501] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:01:49,357 WARN [Listener at localhost/46501] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:49,358 INFO [Listener at localhost/46501] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:49,364 INFO [Listener at localhost/46501] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/java.io.tmpdir/Jetty_localhost_38137_datanode____v5mppz/webapp 2023-02-15 23:01:49,458 INFO [Listener at localhost/46501] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38137 2023-02-15 23:01:49,472 WARN [Listener at localhost/33293] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:49,489 WARN [Listener at localhost/33293] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 23:01:49,490 WARN [Listener at localhost/33293] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 23:01:49,491 INFO [Listener at localhost/33293] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 23:01:49,497 INFO [Listener at localhost/33293] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/java.io.tmpdir/Jetty_localhost_36817_datanode____q73t6q/webapp 2023-02-15 23:01:49,570 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8b590e33c528e1da: Processing first storage report for DS-17cecfc2-a9e1-4869-83de-e514a2c21530 from datanode 00693cc8-4d78-420f-9e5b-3b07e958750d 2023-02-15 23:01:49,570 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8b590e33c528e1da: from storage DS-17cecfc2-a9e1-4869-83de-e514a2c21530 node DatanodeRegistration(127.0.0.1:46747, datanodeUuid=00693cc8-4d78-420f-9e5b-3b07e958750d, infoPort=45071, infoSecurePort=0, ipcPort=33293, storageInfo=lv=-57;cid=testClusterID;nsid=921997101;c=1676502109152), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:49,570 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8b590e33c528e1da: Processing first storage report for DS-e12cbd48-fb9d-4b84-91ec-cec53809a458 from datanode 00693cc8-4d78-420f-9e5b-3b07e958750d 2023-02-15 23:01:49,570 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8b590e33c528e1da: from storage DS-e12cbd48-fb9d-4b84-91ec-cec53809a458 node DatanodeRegistration(127.0.0.1:46747, datanodeUuid=00693cc8-4d78-420f-9e5b-3b07e958750d, infoPort=45071, infoSecurePort=0, ipcPort=33293, storageInfo=lv=-57;cid=testClusterID;nsid=921997101;c=1676502109152), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:49,600 INFO [Listener at localhost/33293] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36817 2023-02-15 23:01:49,608 WARN [Listener at localhost/34631] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 23:01:49,692 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x73df4894f8d1b097: Processing first storage report for DS-1dd66573-6626-4305-b00d-17591d8c117e from datanode 5b62c87f-a2b0-4400-9d6a-b056fdfb9e26 2023-02-15 23:01:49,692 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x73df4894f8d1b097: from storage DS-1dd66573-6626-4305-b00d-17591d8c117e node DatanodeRegistration(127.0.0.1:38849, datanodeUuid=5b62c87f-a2b0-4400-9d6a-b056fdfb9e26, infoPort=41011, infoSecurePort=0, ipcPort=34631, storageInfo=lv=-57;cid=testClusterID;nsid=921997101;c=1676502109152), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:49,692 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x73df4894f8d1b097: Processing first storage report for DS-56bc8e40-62bb-4311-83c1-c6bab98cf0ed from datanode 5b62c87f-a2b0-4400-9d6a-b056fdfb9e26 2023-02-15 23:01:49,692 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x73df4894f8d1b097: from storage DS-56bc8e40-62bb-4311-83c1-c6bab98cf0ed node DatanodeRegistration(127.0.0.1:38849, datanodeUuid=5b62c87f-a2b0-4400-9d6a-b056fdfb9e26, infoPort=41011, infoSecurePort=0, ipcPort=34631, storageInfo=lv=-57;cid=testClusterID;nsid=921997101;c=1676502109152), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 23:01:49,714 DEBUG [Listener at localhost/34631] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef 2023-02-15 23:01:49,716 INFO [Listener at localhost/34631] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/cluster_e2fecff1-f66f-f2b8-63e8-80a828581726/zookeeper_0, clientPort=49907, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/cluster_e2fecff1-f66f-f2b8-63e8-80a828581726/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/cluster_e2fecff1-f66f-f2b8-63e8-80a828581726/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 23:01:49,717 INFO [Listener at localhost/34631] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49907 2023-02-15 23:01:49,717 INFO [Listener at localhost/34631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:49,718 INFO [Listener at localhost/34631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:49,729 INFO [Listener at localhost/34631] util.FSUtils(479): Created version file at hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d with version=8 2023-02-15 23:01:49,729 INFO [Listener at localhost/34631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:49,730 INFO [Listener at localhost/34631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:49,731 INFO [Listener at localhost/34631] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46501/user/jenkins/test-data/71166f71-92af-e8ed-2ec2-6d2f228d5b22/hbase-staging 2023-02-15 23:01:49,732 INFO [Listener at localhost/34631] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:49,732 INFO [Listener at localhost/34631] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:49,732 INFO [Listener at localhost/34631] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:49,733 INFO [Listener at localhost/34631] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:49,733 INFO [Listener at localhost/34631] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:49,733 INFO [Listener at localhost/34631] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:49,733 INFO [Listener at localhost/34631] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:49,734 INFO [Listener at localhost/34631] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41827 2023-02-15 23:01:49,734 INFO [Listener at localhost/34631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:49,735 INFO [Listener at localhost/34631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:49,735 INFO [Listener at localhost/34631] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41827 connecting to ZooKeeper ensemble=127.0.0.1:49907 2023-02-15 23:01:49,742 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:418270x0, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:49,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41827-0x1005a37f7d90000 connected 2023-02-15 23:01:49,761 DEBUG [Listener at localhost/34631] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:49,761 DEBUG [Listener at localhost/34631] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:49,762 DEBUG [Listener at localhost/34631] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:49,762 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41827 2023-02-15 23:01:49,764 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41827 2023-02-15 23:01:49,764 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41827 2023-02-15 23:01:49,768 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41827 2023-02-15 23:01:49,768 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41827 2023-02-15 23:01:49,768 INFO [Listener at localhost/34631] master.HMaster(444): hbase.rootdir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d, hbase.cluster.distributed=false 2023-02-15 23:01:49,780 INFO [Listener at localhost/34631] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:49,780 INFO [Listener at localhost/34631] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:49,780 INFO [Listener at localhost/34631] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:49,780 INFO [Listener at localhost/34631] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:49,780 INFO [Listener at localhost/34631] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:49,780 INFO [Listener at localhost/34631] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:49,780 INFO [Listener at localhost/34631] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:49,781 INFO [Listener at localhost/34631] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38653 2023-02-15 23:01:49,781 INFO [Listener at localhost/34631] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:49,784 DEBUG [Listener at localhost/34631] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:49,784 INFO [Listener at localhost/34631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:49,785 INFO [Listener at localhost/34631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:49,786 INFO [Listener at localhost/34631] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38653 connecting to ZooKeeper ensemble=127.0.0.1:49907 2023-02-15 23:01:49,788 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:386530x0, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:49,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38653-0x1005a37f7d90001 connected 2023-02-15 23:01:49,790 DEBUG [Listener at localhost/34631] zookeeper.ZKUtil(164): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:49,791 DEBUG [Listener at localhost/34631] zookeeper.ZKUtil(164): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:49,791 DEBUG [Listener at localhost/34631] zookeeper.ZKUtil(164): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:49,792 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38653 2023-02-15 23:01:49,792 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38653 2023-02-15 23:01:49,794 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38653 2023-02-15 23:01:49,799 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38653 2023-02-15 23:01:49,799 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38653 2023-02-15 23:01:49,809 INFO [Listener at localhost/34631] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 23:01:49,809 INFO [Listener at localhost/34631] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:49,809 INFO [Listener at localhost/34631] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:49,809 INFO [Listener at localhost/34631] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 23:01:49,810 INFO [Listener at localhost/34631] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 23:01:49,810 INFO [Listener at localhost/34631] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 23:01:49,810 INFO [Listener at localhost/34631] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 23:01:49,810 INFO [Listener at localhost/34631] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37233 2023-02-15 23:01:49,811 INFO [Listener at localhost/34631] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 23:01:49,811 DEBUG [Listener at localhost/34631] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:49,811 INFO [Listener at localhost/34631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:49,812 INFO [Listener at localhost/34631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:49,813 INFO [Listener at localhost/34631] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37233 connecting to ZooKeeper ensemble=127.0.0.1:49907 2023-02-15 23:01:49,817 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:372330x0, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 23:01:49,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37233-0x1005a37f7d90002 connected 2023-02-15 23:01:49,818 DEBUG [Listener at localhost/34631] zookeeper.ZKUtil(164): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:49,819 DEBUG [Listener at localhost/34631] zookeeper.ZKUtil(164): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:49,819 DEBUG [Listener at localhost/34631] zookeeper.ZKUtil(164): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 23:01:49,820 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37233 2023-02-15 23:01:49,824 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37233 2023-02-15 23:01:49,824 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37233 2023-02-15 23:01:49,824 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37233 2023-02-15 23:01:49,824 DEBUG [Listener at localhost/34631] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37233 2023-02-15 23:01:49,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41827,1676502109732 2023-02-15 23:01:49,827 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:49,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41827,1676502109732 2023-02-15 23:01:49,831 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:49,831 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:49,831 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:49,833 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:49,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:49,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 23:01:49,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41827,1676502109732 from backup master directory 2023-02-15 23:01:49,836 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41827,1676502109732 2023-02-15 23:01:49,836 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 23:01:49,836 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:49,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41827,1676502109732 2023-02-15 23:01:49,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/hbase.id with ID: ff30d77a-69d4-422a-a585-e3151f340827 2023-02-15 23:01:49,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 23:01:49,860 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:50,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x31080d82 to 127.0.0.1:49907 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:50,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7609fca8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:50,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:50,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 23:01:50,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:50,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/MasterData/data/master/store-tmp 2023-02-15 23:01:50,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:50,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:50,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:50,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:50,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:50,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:50,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:50,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:50,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/MasterData/WALs/jenkins-hbase4.apache.org,41827,1676502109732 2023-02-15 23:01:50,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41827%2C1676502109732, suffix=, logDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/MasterData/WALs/jenkins-hbase4.apache.org,41827,1676502109732, archiveDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/MasterData/oldWALs, maxLogs=10 2023-02-15 23:01:50,298 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38849,DS-1dd66573-6626-4305-b00d-17591d8c117e,DISK] 2023-02-15 23:01:50,298 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46747,DS-17cecfc2-a9e1-4869-83de-e514a2c21530,DISK] 2023-02-15 23:01:50,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/MasterData/WALs/jenkins-hbase4.apache.org,41827,1676502109732/jenkins-hbase4.apache.org%2C41827%2C1676502109732.1676502110287 2023-02-15 23:01:50,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38849,DS-1dd66573-6626-4305-b00d-17591d8c117e,DISK], DatanodeInfoWithStorage[127.0.0.1:46747,DS-17cecfc2-a9e1-4869-83de-e514a2c21530,DISK]] 2023-02-15 23:01:50,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:50,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:50,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:50,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:50,301 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:50,302 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 23:01:50,303 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 23:01:50,303 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:50,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:50,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:50,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 23:01:50,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:50,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67511885, jitterRate=0.006005480885505676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:50,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:50,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 23:01:50,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 23:01:50,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 23:01:50,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 23:01:50,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 23:01:50,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 23:01:50,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 23:01:50,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 23:01:50,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 23:01:50,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 23:01:50,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 23:01:50,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 23:01:50,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 23:01:50,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 23:01:50,324 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:50,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 23:01:50,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 23:01:50,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 23:01:50,327 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:50,327 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:50,327 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:50,327 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:50,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41827,1676502109732, sessionid=0x1005a37f7d90000, setting cluster-up flag (Was=false) 2023-02-15 23:01:50,333 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:50,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 23:01:50,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41827,1676502109732 2023-02-15 23:01:50,342 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:50,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 23:01:50,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41827,1676502109732 2023-02-15 23:01:50,346 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.hbase-snapshot/.tmp 2023-02-15 23:01:50,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:50,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:50,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:50,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:50,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 23:01:50,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 23:01:50,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:50,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676502140349 2023-02-15 23:01:50,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 23:01:50,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 23:01:50,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 23:01:50,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 23:01:50,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 23:01:50,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 23:01:50,350 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:50,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,350 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 23:01:50,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 23:01:50,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 23:01:50,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 23:01:50,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 23:01:50,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 23:01:50,351 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:50,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502110351,5,FailOnTimeoutGroup] 2023-02-15 23:01:50,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502110351,5,FailOnTimeoutGroup] 2023-02-15 23:01:50,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 23:01:50,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,362 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:50,363 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:50,363 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d 2023-02-15 23:01:50,372 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:50,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:50,374 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/info 2023-02-15 23:01:50,374 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:50,375 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:50,375 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:50,376 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:50,376 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:50,377 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:50,377 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:50,378 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/table 2023-02-15 23:01:50,378 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:50,378 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:50,379 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740 2023-02-15 23:01:50,379 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740 2023-02-15 23:01:50,380 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:50,381 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:50,382 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:50,383 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73455042, jitterRate=0.09456542134284973}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:50,383 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:50,383 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:50,383 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:50,383 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:50,383 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:50,383 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:50,383 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:50,383 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:50,384 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 23:01:50,384 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 23:01:50,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 23:01:50,387 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 23:01:50,388 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 23:01:50,427 INFO [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(952): ClusterId : ff30d77a-69d4-422a-a585-e3151f340827 2023-02-15 23:01:50,427 INFO [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(952): ClusterId : ff30d77a-69d4-422a-a585-e3151f340827 2023-02-15 23:01:50,427 DEBUG [RS:1;jenkins-hbase4:37233] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:50,427 DEBUG [RS:0;jenkins-hbase4:38653] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 23:01:50,430 DEBUG [RS:0;jenkins-hbase4:38653] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:50,430 DEBUG [RS:0;jenkins-hbase4:38653] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:50,430 DEBUG [RS:1;jenkins-hbase4:37233] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 23:01:50,430 DEBUG [RS:1;jenkins-hbase4:37233] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 23:01:50,433 DEBUG [RS:0;jenkins-hbase4:38653] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:50,434 DEBUG [RS:1;jenkins-hbase4:37233] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 23:01:50,435 DEBUG [RS:0;jenkins-hbase4:38653] zookeeper.ReadOnlyZKClient(139): Connect 0x2a4cf89b to 127.0.0.1:49907 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:50,435 DEBUG [RS:1;jenkins-hbase4:37233] zookeeper.ReadOnlyZKClient(139): Connect 0x49174dd2 to 127.0.0.1:49907 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:50,443 DEBUG [RS:1;jenkins-hbase4:37233] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47d0aa80, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:50,443 DEBUG [RS:1;jenkins-hbase4:37233] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43ef26a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:50,446 DEBUG [RS:0;jenkins-hbase4:38653] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@248b03a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:50,446 DEBUG [RS:0;jenkins-hbase4:38653] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20b493eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:50,452 DEBUG [RS:1;jenkins-hbase4:37233] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37233 2023-02-15 23:01:50,452 INFO [RS:1;jenkins-hbase4:37233] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:50,452 INFO [RS:1;jenkins-hbase4:37233] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:50,452 DEBUG [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:50,452 INFO [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41827,1676502109732 with isa=jenkins-hbase4.apache.org/172.31.14.131:37233, startcode=1676502109809 2023-02-15 23:01:50,452 DEBUG [RS:1;jenkins-hbase4:37233] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:50,453 DEBUG [RS:0;jenkins-hbase4:38653] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38653 2023-02-15 23:01:50,453 INFO [RS:0;jenkins-hbase4:38653] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 23:01:50,454 INFO [RS:0;jenkins-hbase4:38653] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 23:01:50,454 DEBUG [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 23:01:50,454 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58067, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:50,454 INFO [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41827,1676502109732 with isa=jenkins-hbase4.apache.org/172.31.14.131:38653, startcode=1676502109779 2023-02-15 23:01:50,454 DEBUG [RS:0;jenkins-hbase4:38653] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 23:01:50,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:50,456 DEBUG [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d 2023-02-15 23:01:50,456 DEBUG [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46501 2023-02-15 23:01:50,456 DEBUG [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:50,457 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59479, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 23:01:50,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:50,458 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:50,458 DEBUG [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d 2023-02-15 23:01:50,458 DEBUG [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46501 2023-02-15 23:01:50,458 DEBUG [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 23:01:50,459 DEBUG [RS:1;jenkins-hbase4:37233] zookeeper.ZKUtil(162): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:50,459 WARN [RS:1;jenkins-hbase4:37233] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:50,459 INFO [RS:1;jenkins-hbase4:37233] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:50,459 DEBUG [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/WALs/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:50,464 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37233,1676502109809] 2023-02-15 23:01:50,464 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38653,1676502109779] 2023-02-15 23:01:50,464 DEBUG [RS:0;jenkins-hbase4:38653] zookeeper.ZKUtil(162): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:50,464 WARN [RS:0;jenkins-hbase4:38653] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 23:01:50,464 INFO [RS:0;jenkins-hbase4:38653] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:50,464 DEBUG [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/WALs/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:50,464 DEBUG [RS:1;jenkins-hbase4:37233] zookeeper.ZKUtil(162): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:50,465 DEBUG [RS:1;jenkins-hbase4:37233] zookeeper.ZKUtil(162): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:50,468 DEBUG [RS:1;jenkins-hbase4:37233] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:50,469 INFO [RS:1;jenkins-hbase4:37233] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:50,469 DEBUG [RS:0;jenkins-hbase4:38653] zookeeper.ZKUtil(162): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:50,469 DEBUG [RS:0;jenkins-hbase4:38653] zookeeper.ZKUtil(162): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:50,470 INFO [RS:1;jenkins-hbase4:37233] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:50,470 DEBUG [RS:0;jenkins-hbase4:38653] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 23:01:50,470 INFO [RS:1;jenkins-hbase4:37233] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:50,470 INFO [RS:0;jenkins-hbase4:38653] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 23:01:50,470 INFO [RS:1;jenkins-hbase4:37233] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,470 INFO [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:50,474 INFO [RS:1;jenkins-hbase4:37233] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,475 DEBUG [RS:1;jenkins-hbase4:37233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,476 DEBUG [RS:1;jenkins-hbase4:37233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,476 DEBUG [RS:1;jenkins-hbase4:37233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,476 DEBUG [RS:1;jenkins-hbase4:37233] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,476 DEBUG [RS:1;jenkins-hbase4:37233] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,476 DEBUG [RS:1;jenkins-hbase4:37233] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:50,476 DEBUG [RS:1;jenkins-hbase4:37233] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,476 DEBUG [RS:1;jenkins-hbase4:37233] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,476 DEBUG [RS:1;jenkins-hbase4:37233] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,476 INFO [RS:0;jenkins-hbase4:38653] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 23:01:50,476 DEBUG [RS:1;jenkins-hbase4:37233] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,477 INFO [RS:0;jenkins-hbase4:38653] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 23:01:50,477 INFO [RS:0;jenkins-hbase4:38653] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,477 INFO [RS:1;jenkins-hbase4:37233] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,477 INFO [RS:1;jenkins-hbase4:37233] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,477 INFO [RS:1;jenkins-hbase4:37233] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,477 INFO [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 23:01:50,478 INFO [RS:0;jenkins-hbase4:38653] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,479 DEBUG [RS:0;jenkins-hbase4:38653] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,479 DEBUG [RS:0;jenkins-hbase4:38653] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,479 DEBUG [RS:0;jenkins-hbase4:38653] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,479 DEBUG [RS:0;jenkins-hbase4:38653] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,479 DEBUG [RS:0;jenkins-hbase4:38653] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,479 DEBUG [RS:0;jenkins-hbase4:38653] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 23:01:50,479 DEBUG [RS:0;jenkins-hbase4:38653] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,479 DEBUG [RS:0;jenkins-hbase4:38653] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,479 DEBUG [RS:0;jenkins-hbase4:38653] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,479 DEBUG [RS:0;jenkins-hbase4:38653] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 23:01:50,483 INFO [RS:0;jenkins-hbase4:38653] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,483 INFO [RS:0;jenkins-hbase4:38653] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,483 INFO [RS:0;jenkins-hbase4:38653] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,490 INFO [RS:1;jenkins-hbase4:37233] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:50,490 INFO [RS:1;jenkins-hbase4:37233] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37233,1676502109809-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,493 INFO [RS:0;jenkins-hbase4:38653] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 23:01:50,493 INFO [RS:0;jenkins-hbase4:38653] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38653,1676502109779-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,503 INFO [RS:1;jenkins-hbase4:37233] regionserver.Replication(203): jenkins-hbase4.apache.org,37233,1676502109809 started 2023-02-15 23:01:50,503 INFO [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37233,1676502109809, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37233, sessionid=0x1005a37f7d90002 2023-02-15 23:01:50,503 INFO [RS:0;jenkins-hbase4:38653] regionserver.Replication(203): jenkins-hbase4.apache.org,38653,1676502109779 started 2023-02-15 23:01:50,503 DEBUG [RS:1;jenkins-hbase4:37233] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:50,503 DEBUG [RS:1;jenkins-hbase4:37233] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:50,503 DEBUG [RS:1;jenkins-hbase4:37233] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37233,1676502109809' 2023-02-15 23:01:50,503 DEBUG [RS:1;jenkins-hbase4:37233] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:50,503 INFO [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38653,1676502109779, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38653, sessionid=0x1005a37f7d90001 2023-02-15 23:01:50,503 DEBUG [RS:0;jenkins-hbase4:38653] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 23:01:50,503 DEBUG [RS:0;jenkins-hbase4:38653] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:50,503 DEBUG [RS:0;jenkins-hbase4:38653] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38653,1676502109779' 2023-02-15 23:01:50,503 DEBUG [RS:0;jenkins-hbase4:38653] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:50,503 DEBUG [RS:1;jenkins-hbase4:37233] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:50,503 DEBUG [RS:0;jenkins-hbase4:38653] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:50,504 DEBUG [RS:0;jenkins-hbase4:38653] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:50,504 DEBUG [RS:1;jenkins-hbase4:37233] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 23:01:50,504 DEBUG [RS:1;jenkins-hbase4:37233] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:50,504 DEBUG [RS:1;jenkins-hbase4:37233] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:50,504 DEBUG [RS:1;jenkins-hbase4:37233] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37233,1676502109809' 2023-02-15 23:01:50,504 DEBUG [RS:1;jenkins-hbase4:37233] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:50,504 DEBUG [RS:0;jenkins-hbase4:38653] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 23:01:50,504 DEBUG [RS:0;jenkins-hbase4:38653] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:50,504 DEBUG [RS:0;jenkins-hbase4:38653] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38653,1676502109779' 2023-02-15 23:01:50,504 DEBUG [RS:0;jenkins-hbase4:38653] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:50,504 DEBUG [RS:1;jenkins-hbase4:37233] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:50,504 DEBUG [RS:0;jenkins-hbase4:38653] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:50,504 DEBUG [RS:1;jenkins-hbase4:37233] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:50,504 INFO [RS:1;jenkins-hbase4:37233] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:50,504 INFO [RS:1;jenkins-hbase4:37233] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:50,504 DEBUG [RS:0;jenkins-hbase4:38653] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 23:01:50,504 INFO [RS:0;jenkins-hbase4:38653] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 23:01:50,504 INFO [RS:0;jenkins-hbase4:38653] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 23:01:50,538 DEBUG [jenkins-hbase4:41827] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 23:01:50,538 DEBUG [jenkins-hbase4:41827] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:50,540 DEBUG [jenkins-hbase4:41827] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:50,540 DEBUG [jenkins-hbase4:41827] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:50,540 DEBUG [jenkins-hbase4:41827] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:50,540 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38653,1676502109779, state=OPENING 2023-02-15 23:01:50,541 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 23:01:50,542 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:50,543 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:50,543 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38653,1676502109779}] 2023-02-15 23:01:50,697 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:50,697 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:50,699 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51130, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:50,703 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 23:01:50,703 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 23:01:50,704 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38653%2C1676502109779.meta, suffix=.meta, logDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/WALs/jenkins-hbase4.apache.org,38653,1676502109779, archiveDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/oldWALs, maxLogs=32 2023-02-15 23:01:50,719 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38849,DS-1dd66573-6626-4305-b00d-17591d8c117e,DISK] 2023-02-15 23:01:50,719 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46747,DS-17cecfc2-a9e1-4869-83de-e514a2c21530,DISK] 2023-02-15 23:01:50,721 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/WALs/jenkins-hbase4.apache.org,38653,1676502109779/jenkins-hbase4.apache.org%2C38653%2C1676502109779.meta.1676502110704.meta 2023-02-15 23:01:50,722 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38849,DS-1dd66573-6626-4305-b00d-17591d8c117e,DISK], DatanodeInfoWithStorage[127.0.0.1:46747,DS-17cecfc2-a9e1-4869-83de-e514a2c21530,DISK]] 2023-02-15 23:01:50,722 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:50,722 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 23:01:50,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 23:01:50,723 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 23:01:50,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 23:01:50,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:50,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 23:01:50,723 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 23:01:50,724 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 23:01:50,725 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/info 2023-02-15 23:01:50,725 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/info 2023-02-15 23:01:50,725 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 23:01:50,725 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:50,725 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 23:01:50,726 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:50,726 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/rep_barrier 2023-02-15 23:01:50,726 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 23:01:50,726 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:50,727 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 23:01:50,727 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/table 2023-02-15 23:01:50,727 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/table 2023-02-15 23:01:50,727 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 23:01:50,728 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:50,728 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740 2023-02-15 23:01:50,729 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740 2023-02-15 23:01:50,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 23:01:50,731 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 23:01:50,732 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69882745, jitterRate=0.04133404791355133}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 23:01:50,732 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 23:01:50,732 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676502110697 2023-02-15 23:01:50,736 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 23:01:50,738 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 23:01:50,738 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38653,1676502109779, state=OPEN 2023-02-15 23:01:50,739 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 23:01:50,739 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 23:01:50,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 23:01:50,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38653,1676502109779 in 196 msec 2023-02-15 23:01:50,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 23:01:50,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-15 23:01:50,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 396 msec 2023-02-15 23:01:50,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676502110742, completionTime=-1 2023-02-15 23:01:50,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 23:01:50,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 23:01:50,745 DEBUG [hconnection-0x48b14744-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:50,746 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51134, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:50,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 23:01:50,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676502170747 2023-02-15 23:01:50,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676502230747 2023-02-15 23:01:50,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-15 23:01:50,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41827,1676502109732-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41827,1676502109732-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41827,1676502109732-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41827, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 23:01:50,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 23:01:50,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:50,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 23:01:50,755 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 23:01:50,756 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:50,757 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:50,758 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/hbase/namespace/c84298982c5ea36002899c1c3a54f73b 2023-02-15 23:01:50,758 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/hbase/namespace/c84298982c5ea36002899c1c3a54f73b empty. 2023-02-15 23:01:50,759 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/hbase/namespace/c84298982c5ea36002899c1c3a54f73b 2023-02-15 23:01:50,759 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 23:01:50,766 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:50,767 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => c84298982c5ea36002899c1c3a54f73b, NAME => 'hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp 2023-02-15 23:01:50,776 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:50,776 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing c84298982c5ea36002899c1c3a54f73b, disabling compactions & flushes 2023-02-15 23:01:50,776 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. 2023-02-15 23:01:50,776 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. 2023-02-15 23:01:50,776 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. after waiting 0 ms 2023-02-15 23:01:50,776 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. 2023-02-15 23:01:50,776 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. 2023-02-15 23:01:50,776 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for c84298982c5ea36002899c1c3a54f73b: 2023-02-15 23:01:50,778 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:50,778 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502110778"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502110778"}]},"ts":"1676502110778"} 2023-02-15 23:01:50,780 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 23:01:50,780 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:50,780 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502110780"}]},"ts":"1676502110780"} 2023-02-15 23:01:50,781 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 23:01:50,784 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:50,784 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:50,784 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:50,784 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:50,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c84298982c5ea36002899c1c3a54f73b, ASSIGN}] 2023-02-15 23:01:50,787 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c84298982c5ea36002899c1c3a54f73b, ASSIGN 2023-02-15 23:01:50,787 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c84298982c5ea36002899c1c3a54f73b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37233,1676502109809; forceNewPlan=false, retain=false 2023-02-15 23:01:50,937 INFO [jenkins-hbase4:41827] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 23:01:50,938 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c84298982c5ea36002899c1c3a54f73b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:50,938 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502110938"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502110938"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502110938"}]},"ts":"1676502110938"} 2023-02-15 23:01:50,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c84298982c5ea36002899c1c3a54f73b, server=jenkins-hbase4.apache.org,37233,1676502109809}] 2023-02-15 23:01:51,092 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:51,093 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 23:01:51,094 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36040, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 23:01:51,098 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. 2023-02-15 23:01:51,099 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37233%2C1676502109809, suffix=, logDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/WALs/jenkins-hbase4.apache.org,37233,1676502109809, archiveDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/oldWALs, maxLogs=32 2023-02-15 23:01:51,112 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46747,DS-17cecfc2-a9e1-4869-83de-e514a2c21530,DISK] 2023-02-15 23:01:51,112 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38849,DS-1dd66573-6626-4305-b00d-17591d8c117e,DISK] 2023-02-15 23:01:51,113 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/WALs/jenkins-hbase4.apache.org,37233,1676502109809/jenkins-hbase4.apache.org%2C37233%2C1676502109809.1676502111099 2023-02-15 23:01:51,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46747,DS-17cecfc2-a9e1-4869-83de-e514a2c21530,DISK], DatanodeInfoWithStorage[127.0.0.1:38849,DS-1dd66573-6626-4305-b00d-17591d8c117e,DISK]] 2023-02-15 23:01:51,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c84298982c5ea36002899c1c3a54f73b, NAME => 'hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:51,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c84298982c5ea36002899c1c3a54f73b 2023-02-15 23:01:51,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:51,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c84298982c5ea36002899c1c3a54f73b 2023-02-15 23:01:51,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c84298982c5ea36002899c1c3a54f73b 2023-02-15 23:01:51,115 INFO [StoreOpener-c84298982c5ea36002899c1c3a54f73b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c84298982c5ea36002899c1c3a54f73b 2023-02-15 23:01:51,116 DEBUG [StoreOpener-c84298982c5ea36002899c1c3a54f73b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/namespace/c84298982c5ea36002899c1c3a54f73b/info 2023-02-15 23:01:51,116 DEBUG [StoreOpener-c84298982c5ea36002899c1c3a54f73b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/namespace/c84298982c5ea36002899c1c3a54f73b/info 2023-02-15 23:01:51,116 INFO [StoreOpener-c84298982c5ea36002899c1c3a54f73b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c84298982c5ea36002899c1c3a54f73b columnFamilyName info 2023-02-15 23:01:51,117 INFO [StoreOpener-c84298982c5ea36002899c1c3a54f73b-1] regionserver.HStore(310): Store=c84298982c5ea36002899c1c3a54f73b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:51,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/namespace/c84298982c5ea36002899c1c3a54f73b 2023-02-15 23:01:51,118 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/namespace/c84298982c5ea36002899c1c3a54f73b 2023-02-15 23:01:51,119 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c84298982c5ea36002899c1c3a54f73b 2023-02-15 23:01:51,120 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/namespace/c84298982c5ea36002899c1c3a54f73b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:51,121 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c84298982c5ea36002899c1c3a54f73b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61884725, jitterRate=-0.0778457373380661}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 23:01:51,121 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c84298982c5ea36002899c1c3a54f73b: 2023-02-15 23:01:51,121 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b., pid=6, masterSystemTime=1676502111092 2023-02-15 23:01:51,124 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. 2023-02-15 23:01:51,124 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. 2023-02-15 23:01:51,124 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c84298982c5ea36002899c1c3a54f73b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:51,124 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676502111124"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502111124"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502111124"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502111124"}]},"ts":"1676502111124"} 2023-02-15 23:01:51,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 23:01:51,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c84298982c5ea36002899c1c3a54f73b, server=jenkins-hbase4.apache.org,37233,1676502109809 in 186 msec 2023-02-15 23:01:51,128 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 23:01:51,128 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c84298982c5ea36002899c1c3a54f73b, ASSIGN in 341 msec 2023-02-15 23:01:51,128 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:51,128 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502111128"}]},"ts":"1676502111128"} 2023-02-15 23:01:51,129 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 23:01:51,132 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:51,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 378 msec 2023-02-15 23:01:51,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 23:01:51,156 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:51,156 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:51,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:51,159 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36048, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:51,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 23:01:51,166 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:51,169 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-15 23:01:51,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 23:01:51,179 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 23:01:51,181 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-15 23:01:51,186 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 23:01:51,194 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 23:01:51,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.358sec 2023-02-15 23:01:51,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 23:01:51,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 23:01:51,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 23:01:51,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41827,1676502109732-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 23:01:51,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41827,1676502109732-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 23:01:51,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 23:01:51,227 DEBUG [Listener at localhost/34631] zookeeper.ReadOnlyZKClient(139): Connect 0x2549adab to 127.0.0.1:49907 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:51,230 DEBUG [Listener at localhost/34631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3798f941, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:51,232 DEBUG [hconnection-0x53b8bb92-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:51,233 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51144, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:51,234 INFO [Listener at localhost/34631] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41827,1676502109732 2023-02-15 23:01:51,234 DEBUG [Listener at localhost/34631] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 23:01:51,237 DEBUG [Listener at localhost/34631] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 23:01:51,238 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58756, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 23:01:51,238 INFO [Listener at localhost/34631] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 23:01:51,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 23:01:51,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 23:01:51,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:58756 deadline: 1676502171238, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-15 23:01:51,239 INFO [Listener at localhost/34631] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-15 23:01:51,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 23:01:51,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-15 23:01:51,243 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 23:01:51,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-15 23:01:51,243 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 23:01:51,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:51,245 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:51,245 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389 empty. 2023-02-15 23:01:51,245 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:51,245 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 23:01:51,252 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-15 23:01:51,253 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 77d7b97ad8e23db2d08e4741a7d04389, NAME => 'testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp 2023-02-15 23:01:51,259 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:51,259 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 77d7b97ad8e23db2d08e4741a7d04389, disabling compactions & flushes 2023-02-15 23:01:51,259 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:51,259 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:51,259 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. after waiting 0 ms 2023-02-15 23:01:51,259 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:51,259 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:51,259 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 77d7b97ad8e23db2d08e4741a7d04389: 2023-02-15 23:01:51,261 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 23:01:51,261 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676502111261"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502111261"}]},"ts":"1676502111261"} 2023-02-15 23:01:51,263 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 23:01:51,263 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 23:01:51,263 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502111263"}]},"ts":"1676502111263"} 2023-02-15 23:01:51,264 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-15 23:01:51,268 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 23:01:51,269 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 23:01:51,269 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 23:01:51,269 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 23:01:51,269 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=77d7b97ad8e23db2d08e4741a7d04389, ASSIGN}] 2023-02-15 23:01:51,270 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=77d7b97ad8e23db2d08e4741a7d04389, ASSIGN 2023-02-15 23:01:51,270 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=77d7b97ad8e23db2d08e4741a7d04389, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38653,1676502109779; forceNewPlan=false, retain=false 2023-02-15 23:01:51,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:51,421 INFO [jenkins-hbase4:41827] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 23:01:51,421 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=77d7b97ad8e23db2d08e4741a7d04389, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:51,421 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676502111421"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502111421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502111421"}]},"ts":"1676502111421"} 2023-02-15 23:01:51,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 77d7b97ad8e23db2d08e4741a7d04389, server=jenkins-hbase4.apache.org,38653,1676502109779}] 2023-02-15 23:01:51,506 INFO [RS:0;jenkins-hbase4:38653] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38653%2C1676502109779, suffix=, logDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/WALs/jenkins-hbase4.apache.org,38653,1676502109779, archiveDir=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/oldWALs, maxLogs=32 2023-02-15 23:01:51,519 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46747,DS-17cecfc2-a9e1-4869-83de-e514a2c21530,DISK] 2023-02-15 23:01:51,519 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38849,DS-1dd66573-6626-4305-b00d-17591d8c117e,DISK] 2023-02-15 23:01:51,521 INFO [RS:0;jenkins-hbase4:38653] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/WALs/jenkins-hbase4.apache.org,38653,1676502109779/jenkins-hbase4.apache.org%2C38653%2C1676502109779.1676502111506 2023-02-15 23:01:51,521 DEBUG [RS:0;jenkins-hbase4:38653] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38849,DS-1dd66573-6626-4305-b00d-17591d8c117e,DISK], DatanodeInfoWithStorage[127.0.0.1:46747,DS-17cecfc2-a9e1-4869-83de-e514a2c21530,DISK]] 2023-02-15 23:01:51,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:51,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:51,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 77d7b97ad8e23db2d08e4741a7d04389, NAME => 'testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.', STARTKEY => '', ENDKEY => ''} 2023-02-15 23:01:51,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:51,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:51,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:51,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:51,578 INFO [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:51,579 DEBUG [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1 2023-02-15 23:01:51,580 DEBUG [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1 2023-02-15 23:01:51,580 INFO [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77d7b97ad8e23db2d08e4741a7d04389 columnFamilyName f1 2023-02-15 23:01:51,580 INFO [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] regionserver.HStore(310): Store=77d7b97ad8e23db2d08e4741a7d04389/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:51,580 INFO [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:51,582 DEBUG [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2 2023-02-15 23:01:51,582 DEBUG [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2 2023-02-15 23:01:51,582 INFO [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77d7b97ad8e23db2d08e4741a7d04389 columnFamilyName f2 2023-02-15 23:01:51,582 INFO [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] regionserver.HStore(310): Store=77d7b97ad8e23db2d08e4741a7d04389/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:51,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:51,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:51,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:51,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:51,588 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 23:01:51,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 23:01:51,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 77d7b97ad8e23db2d08e4741a7d04389; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68011874, jitterRate=0.013455897569656372}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:51,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 77d7b97ad8e23db2d08e4741a7d04389: 2023-02-15 23:01:51,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389., pid=12, masterSystemTime=1676502111574 2023-02-15 23:01:51,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:51,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:51,594 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=77d7b97ad8e23db2d08e4741a7d04389, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:51,594 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676502111594"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676502111594"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676502111594"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676502111594"}]},"ts":"1676502111594"} 2023-02-15 23:01:51,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 23:01:51,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 77d7b97ad8e23db2d08e4741a7d04389, server=jenkins-hbase4.apache.org,38653,1676502109779 in 172 msec 2023-02-15 23:01:51,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 23:01:51,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=77d7b97ad8e23db2d08e4741a7d04389, ASSIGN in 328 msec 2023-02-15 23:01:51,599 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 23:01:51,599 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502111599"}]},"ts":"1676502111599"} 2023-02-15 23:01:51,600 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-15 23:01:51,602 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 23:01:51,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 361 msec 2023-02-15 23:01:51,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 23:01:51,848 INFO [Listener at localhost/34631] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-15 23:01:51,848 DEBUG [Listener at localhost/34631] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-15 23:01:51,848 INFO [Listener at localhost/34631] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:51,850 INFO [Listener at localhost/34631] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-15 23:01:51,850 INFO [Listener at localhost/34631] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 23:01:51,850 INFO [Listener at localhost/34631] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-15 23:01:51,850 INFO [Listener at localhost/34631] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 23:01:51,879 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38653] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:51,964 INFO [Listener at localhost/34631] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 23:01:51,964 INFO [Listener at localhost/34631] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 23:01:51,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 23:01:51,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676502111966 (current time:1676502111966). 2023-02-15 23:01:51,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 23:01:51,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] zookeeper.ReadOnlyZKClient(139): Connect 0x244741ac to 127.0.0.1:49907 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 23:01:51,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21e39b20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 23:01:51,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 23:01:51,989 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51154, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 23:01:51,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x244741ac to 127.0.0.1:49907 2023-02-15 23:01:51,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:51,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 23:01:51,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 23:01:51,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 23:01:51,994 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 23:01:51,994 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676502711994 2023-02-15 23:01:51,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 23:01:51,995 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-15 23:01:51,996 DEBUG [Listener at localhost/34631] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:51,996 DEBUG [Listener at localhost/34631] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 23:01:51,996 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 23:01:51,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 23:01:51,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-15 23:01:51,998 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 23:01:51,998 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676502711998 2023-02-15 23:01:52,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-15 23:01:52,014 INFO [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-15 23:01:52,014 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:52,016 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-15 23:01:52,016 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-15 23:01:52,017 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,017 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 23:01:52,040 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:52,040 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:52,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:52,040 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:52,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:52,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:52,040 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,040 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:52,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 23:01:52,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 23:01:52,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-15 23:01:52,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-15 23:01:52,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 23:01:52,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 23:01:52,041 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-15 23:01:52,041 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-15 23:01:52,041 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-15 23:01:52,042 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-15 23:01:52,042 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-15 23:01:52,042 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:52,042 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-15 23:01:52,043 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 23:01:52,043 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-15 23:01:52,043 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 23:01:52,043 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38653,1676502109779' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-15 23:01:52,045 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 23:01:52,046 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-15 23:01:52,046 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37233,1676502109809' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-15 23:01:52,057 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,057 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 23:01:52,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:52,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:52,057 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 23:01:52,058 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 23:01:52,058 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:52,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:52,058 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 23:01:52,058 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:52,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:52,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 23:01:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:52,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38653,1676502109779' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-15 23:01:52,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@132c3b9[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:52,059 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-15 23:01:52,059 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 23:01:52,078 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 23:01:52,078 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 23:01:52,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 23:01:52,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 23:01:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 23:01:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 23:01:52,078 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 23:01:52,078 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 23:01:52,078 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-15 23:01:52,079 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37233,1676502109809' in zk 2023-02-15 23:01:52,078 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,079 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:52,079 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 23:01:52,079 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 23:01:52,079 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:52,079 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. started... 2023-02-15 23:01:52,079 INFO [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 77d7b97ad8e23db2d08e4741a7d04389 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 23:01:52,092 INFO [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/.tmp/f1/6a19e08dbba444808cb3db0398e3a3ee 2023-02-15 23:01:52,096 DEBUG [Listener at localhost/34631] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:52,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 23:01:52,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 23:01:52,097 DEBUG [Listener at localhost/34631] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 23:01:52,109 INFO [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/.tmp/f2/3f35a218abe146329dc55d198c13e59e 2023-02-15 23:01:52,110 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-15 23:01:52,110 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:52,110 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-15 23:01:52,113 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/.tmp/f1/6a19e08dbba444808cb3db0398e3a3ee as hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1/6a19e08dbba444808cb3db0398e3a3ee 2023-02-15 23:01:52,116 INFO [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1/6a19e08dbba444808cb3db0398e3a3ee, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 23:01:52,117 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/.tmp/f2/3f35a218abe146329dc55d198c13e59e as hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2/3f35a218abe146329dc55d198c13e59e 2023-02-15 23:01:52,120 INFO [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2/3f35a218abe146329dc55d198c13e59e, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 23:01:52,121 INFO [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 77d7b97ad8e23db2d08e4741a7d04389 in 42ms, sequenceid=5, compaction requested=false 2023-02-15 23:01:52,121 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 77d7b97ad8e23db2d08e4741a7d04389: 2023-02-15 23:01:52,121 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-15 23:01:52,121 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 23:01:52,121 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1/6a19e08dbba444808cb3db0398e3a3ee] hfiles 2023-02-15 23:01:52,121 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1/6a19e08dbba444808cb3db0398e3a3ee for snapshot=testWithMapReduceSingleRegion 2023-02-15 23:01:52,121 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2/3f35a218abe146329dc55d198c13e59e] hfiles 2023-02-15 23:01:52,122 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2/3f35a218abe146329dc55d198c13e59e for snapshot=testWithMapReduceSingleRegion 2023-02-15 23:01:52,132 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. completed. 2023-02-15 23:01:52,132 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:52,132 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 23:01:52,132 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 23:01:52,132 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,132 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-15 23:01:52,132 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38653,1676502109779' in zk 2023-02-15 23:01:52,134 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-15 23:01:52,134 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,134 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:52,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,134 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-15 23:01:52,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:52,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:52,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:52,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:52,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 23:01:52,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:52,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 23:01:52,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,38653,1676502109779': 2023-02-15 23:01:52,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38653,1676502109779' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-15 23:01:52,137 INFO [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-15 23:01:52,137 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:52,137 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:52,137 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-15 23:01:52,137 INFO [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 23:01:52,139 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,139 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,139 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:52,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 23:01:52,139 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:52,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,139 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:52,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:52,139 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:52,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:52,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 23:01:52,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:52,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:52,140 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:52,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 23:01:52,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:52,141 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 23:01:52,142 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,148 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,148 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:52,148 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 23:01:52,148 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 23:01:52,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:52,148 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:52,148 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:52,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 23:01:52,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:52,148 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 23:01:52,148 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-15 23:01:52,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 23:01:52,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-15 23:01:52,148 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,149 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 23:01:52,149 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,149 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 23:01:52,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:52,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:52,149 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 23:01:52,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 23:01:52,149 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 23:01:52,149 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 23:01:52,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-15 23:01:52,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-15 23:01:52,193 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-15 23:01:52,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-15 23:01:52,193 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-15 23:01:52,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676502111995Consolidate snapshot: testWithMapReduceSingleRegion at 1676502112149 (+154 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676502112149Writing data manifest for testWithMapReduceSingleRegion at 1676502112151 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676502112158 (+7 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676502112193 (+35 ms) 2023-02-15 23:01:52,195 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 23:01:52,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 199 msec 2023-02-15 23:01:52,298 DEBUG [Listener at localhost/34631] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 23:01:52,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 23:01:52,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 23:01:52,299 INFO [Listener at localhost/34631] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 23:01:52,302 INFO [Listener at localhost/34631] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 23:01:52,307 INFO [Listener at localhost/34631] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 23:01:52,336 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38653] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:52,417 INFO [Listener at localhost/34631] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 23:01:52,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 23:01:52,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-15 23:01:52,423 INFO [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-15 23:01:52,423 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:52,423 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-15 23:01:52,423 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-15 23:01:52,423 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,423 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:52,425 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:52,425 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:52,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:52,425 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:52,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:52,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:52,426 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,426 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 23:01:52,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:52,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:52,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:52,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:52,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 23:01:52,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:52,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 23:01:52,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 23:01:52,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 23:01:52,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 23:01:52,427 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 23:01:52,427 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:52,427 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 23:01:52,427 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 23:01:52,427 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 23:01:52,427 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 23:01:52,427 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37233,1676502109809' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 23:01:52,427 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 23:01:52,427 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 23:01:52,427 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 23:01:52,427 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:52,427 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. started... 2023-02-15 23:01:52,427 INFO [rs(jenkins-hbase4.apache.org,38653,1676502109779)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 77d7b97ad8e23db2d08e4741a7d04389 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 23:01:52,429 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:52,429 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:52,429 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:52,453 INFO [rs(jenkins-hbase4.apache.org,38653,1676502109779)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/.tmp/f1/5a59d17f469e4f24a95df152ae334f58 2023-02-15 23:01:52,478 INFO [rs(jenkins-hbase4.apache.org,38653,1676502109779)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/.tmp/f2/3a91234aef40411c95de3ba102707a81 2023-02-15 23:01:52,482 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/.tmp/f1/5a59d17f469e4f24a95df152ae334f58 as hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1/5a59d17f469e4f24a95df152ae334f58 2023-02-15 23:01:52,486 INFO [rs(jenkins-hbase4.apache.org,38653,1676502109779)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1/5a59d17f469e4f24a95df152ae334f58, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 23:01:52,486 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/.tmp/f2/3a91234aef40411c95de3ba102707a81 as hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2/3a91234aef40411c95de3ba102707a81 2023-02-15 23:01:52,489 INFO [rs(jenkins-hbase4.apache.org,38653,1676502109779)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2/3a91234aef40411c95de3ba102707a81, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 23:01:52,490 INFO [rs(jenkins-hbase4.apache.org,38653,1676502109779)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 77d7b97ad8e23db2d08e4741a7d04389 in 63ms, sequenceid=9, compaction requested=false 2023-02-15 23:01:52,490 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 77d7b97ad8e23db2d08e4741a7d04389: 2023-02-15 23:01:52,490 DEBUG [rs(jenkins-hbase4.apache.org,38653,1676502109779)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:52,490 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 23:01:52,490 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 23:01:52,490 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,490 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 23:01:52,490 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38653,1676502109779' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 23:01:52,492 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,492 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:52,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:52,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:52,493 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:52,493 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 23:01:52,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:52,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:52,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:52,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:52,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38653,1676502109779' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 23:01:52,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50d4747[Count = 0] remaining members to acquire global barrier 2023-02-15 23:01:52,494 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-15 23:01:52,494 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:52,496 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:52,496 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:52,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:52,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:52,496 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 23:01:52,496 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 23:01:52,496 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 23:01:52,496 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 23:01:52,496 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38653,1676502109779' in zk 2023-02-15 23:01:52,496 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,496 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 23:01:52,496 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,37233,1676502109809' in zk 2023-02-15 23:01:52,498 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 23:01:52,498 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:52,498 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,498 DEBUG [member: 'jenkins-hbase4.apache.org,38653,1676502109779' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 23:01:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:52,498 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 23:01:52,499 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:52,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:52,499 DEBUG [member: 'jenkins-hbase4.apache.org,37233,1676502109809' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 23:01:52,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:52,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:52,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:52,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:52,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38653,1676502109779': 2023-02-15 23:01:52,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38653,1676502109779' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-15 23:01:52,501 INFO [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-15 23:01:52,501 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 23:01:52,501 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 23:01:52,501 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-15 23:01:52,501 INFO [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 23:01:52,502 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,502 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,502 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,502 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:52,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,502 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 23:01:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 23:01:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:52,503 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 23:01:52,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,503 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:52,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 23:01:52,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,505 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,505 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 23:01:52,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 23:01:52,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,509 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,509 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:52,509 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 23:01:52,510 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:52,510 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:52,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:52,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:52,509 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 23:01:52,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-15 23:01:52,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 23:01:52,510 DEBUG [(jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 23:01:52,510 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:52,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:52,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 23:01:52,510 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 23:01:52,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 23:01:52,510 DEBUG [Listener at localhost/34631] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-15 23:01:52,510 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:52,510 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:52,510 DEBUG [Listener at localhost/34631] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 23:01:52,510 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:52,511 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 23:01:52,511 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 23:01:52,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 23:01:52,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 23:01:52,611 DEBUG [Listener at localhost/34631] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 23:01:52,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 23:01:52,698 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/hadoop-6025539132436667832.jar 2023-02-15 23:01:52,702 INFO [Listener at localhost/34631] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676502111966 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:52,702 DEBUG [Listener at localhost/34631] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46501/user/jenkins/test-data/71166f71-92af-e8ed-2ec2-6d2f228d5b22/testWithMapReduceSingleRegion/10c23539-1293-43c0-a41f-7d2de2401f2d/data/default/testWithMapReduce 2023-02-15 23:01:52,702 INFO [Listener at localhost/34631] snapshot.RestoreSnapshotHelper(239): region to add: 77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:52,703 INFO [Listener at localhost/34631] snapshot.RestoreSnapshotHelper(585): clone region=77d7b97ad8e23db2d08e4741a7d04389 as 77d7b97ad8e23db2d08e4741a7d04389 in snapshot testWithMapReduceSingleRegion 2023-02-15 23:01:52,703 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 77d7b97ad8e23db2d08e4741a7d04389, NAME => 'testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46501/user/jenkins/test-data/71166f71-92af-e8ed-2ec2-6d2f228d5b22/testWithMapReduceSingleRegion/10c23539-1293-43c0-a41f-7d2de2401f2d 2023-02-15 23:01:52,709 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:52,709 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6a19e08dbba444808cb3db0398e3a3ee from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-15 23:01:52,711 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3f35a218abe146329dc55d198c13e59e from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-15 23:01:52,712 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 77d7b97ad8e23db2d08e4741a7d04389, disabling compactions & flushes 2023-02-15 23:01:52,712 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:52,712 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:52,712 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. after waiting 0 ms 2023-02-15 23:01:52,712 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:52,712 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:52,712 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 77d7b97ad8e23db2d08e4741a7d04389: 2023-02-15 23:01:52,713 INFO [Listener at localhost/34631] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676502111966 type: FLUSH version: 2 ttl: 0 2023-02-15 23:01:52,713 DEBUG [Listener at localhost/34631] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46501/user/jenkins/test-data/71166f71-92af-e8ed-2ec2-6d2f228d5b22/testWithMapReduceSingleRegion/10c23539-1293-43c0-a41f-7d2de2401f2d 2023-02-15 23:01:52,713 DEBUG [Listener at localhost/34631] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46501/user/jenkins/test-data/71166f71-92af-e8ed-2ec2-6d2f228d5b22/testWithMapReduceSingleRegion/10c23539-1293-43c0-a41f-7d2de2401f2d 2023-02-15 23:01:52,713 DEBUG [Listener at localhost/34631] util.CommonFSUtils(699): |-data/ 2023-02-15 23:01:52,713 DEBUG [Listener at localhost/34631] util.CommonFSUtils(699): |----default/ 2023-02-15 23:01:52,714 DEBUG [Listener at localhost/34631] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-15 23:01:52,714 DEBUG [Listener at localhost/34631] util.CommonFSUtils(699): |----------77d7b97ad8e23db2d08e4741a7d04389/ 2023-02-15 23:01:52,714 DEBUG [Listener at localhost/34631] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 23:01:52,714 DEBUG [Listener at localhost/34631] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 23:01:52,715 DEBUG [Listener at localhost/34631] util.CommonFSUtils(702): |----------------testWithMapReduce=77d7b97ad8e23db2d08e4741a7d04389-6a19e08dbba444808cb3db0398e3a3ee 2023-02-15 23:01:52,715 DEBUG [Listener at localhost/34631] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 23:01:52,715 DEBUG [Listener at localhost/34631] util.CommonFSUtils(702): |----------------testWithMapReduce=77d7b97ad8e23db2d08e4741a7d04389-3f35a218abe146329dc55d198c13e59e 2023-02-15 23:01:52,715 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,716 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,716 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,716 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,717 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,717 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,717 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,782 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/hadoop-4856544667312290275.jar 2023-02-15 23:01:52,783 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,783 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,783 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,784 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,784 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,784 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,785 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-15 23:01:52,785 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-15 23:01:52,785 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-15 23:01:52,786 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-15 23:01:52,786 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-15 23:01:52,786 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-15 23:01:52,787 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-15 23:01:52,787 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-15 23:01:52,787 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-15 23:01:52,788 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-15 23:01:52,788 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 23:01:52,788 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 23:01:52,789 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 23:01:52,789 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 23:01:52,789 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 23:01:52,854 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/hadoop-8301783053635333779.jar 2023-02-15 23:01:52,855 DEBUG [Listener at localhost/34631] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 23:01:52,860 WARN [Listener at localhost/34631] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-15 23:01:52,890 INFO [Listener at localhost/34631] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 23:01:52,967 WARN [Listener at localhost/34631] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/mapreduce.cluster.local.dir/1676502112933/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-15 23:01:52,967 WARN [Listener at localhost/34631] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/mapreduce.cluster.local.dir/1676502112933/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-15 23:01:52,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 23:01:52,999 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 23:01:53,000 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 23:01:53,001 INFO [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:53,002 DEBUG [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/71166f71-92af-e8ed-2ec2-6d2f228d5b22/testWithMapReduceSingleRegion/10c23539-1293-43c0-a41f-7d2de2401f2d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1 2023-02-15 23:01:53,003 INFO [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77d7b97ad8e23db2d08e4741a7d04389 columnFamilyName f1 2023-02-15 23:01:53,006 DEBUG [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] regionserver.HStore(539): loaded hdfs://localhost:46501/user/jenkins/test-data/71166f71-92af-e8ed-2ec2-6d2f228d5b22/testWithMapReduceSingleRegion/10c23539-1293-43c0-a41f-7d2de2401f2d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1/testWithMapReduce=77d7b97ad8e23db2d08e4741a7d04389-6a19e08dbba444808cb3db0398e3a3ee 2023-02-15 23:01:53,007 INFO [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] regionserver.HStore(310): Store=77d7b97ad8e23db2d08e4741a7d04389/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:53,007 INFO [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:53,007 DEBUG [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46501/user/jenkins/test-data/71166f71-92af-e8ed-2ec2-6d2f228d5b22/testWithMapReduceSingleRegion/10c23539-1293-43c0-a41f-7d2de2401f2d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2 2023-02-15 23:01:53,008 INFO [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77d7b97ad8e23db2d08e4741a7d04389 columnFamilyName f2 2023-02-15 23:01:53,011 DEBUG [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] regionserver.HStore(539): loaded hdfs://localhost:46501/user/jenkins/test-data/71166f71-92af-e8ed-2ec2-6d2f228d5b22/testWithMapReduceSingleRegion/10c23539-1293-43c0-a41f-7d2de2401f2d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2/testWithMapReduce=77d7b97ad8e23db2d08e4741a7d04389-3f35a218abe146329dc55d198c13e59e 2023-02-15 23:01:53,011 INFO [StoreOpener-77d7b97ad8e23db2d08e4741a7d04389-1] regionserver.HStore(310): Store=77d7b97ad8e23db2d08e4741a7d04389/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 23:01:53,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 23:01:53,012 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 77d7b97ad8e23db2d08e4741a7d04389; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59421802, jitterRate=-0.11454614996910095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 23:01:53,012 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 77d7b97ad8e23db2d08e4741a7d04389: 2023-02-15 23:01:53,092 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 77d7b97ad8e23db2d08e4741a7d04389, disabling compactions & flushes 2023-02-15 23:01:53,092 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:53,092 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:53,092 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. after waiting 0 ms 2023-02-15 23:01:53,092 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:53,092 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:53,093 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 77d7b97ad8e23db2d08e4741a7d04389: 2023-02-15 23:01:54,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-15 23:01:54,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-15 23:01:54,005 INFO [Listener at localhost/34631] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 23:01:54,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 23:01:54,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-15 23:01:54,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 23:01:54,009 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502114009"}]},"ts":"1676502114009"} 2023-02-15 23:01:54,010 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-15 23:01:54,011 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-15 23:01:54,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=77d7b97ad8e23db2d08e4741a7d04389, UNASSIGN}] 2023-02-15 23:01:54,012 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=77d7b97ad8e23db2d08e4741a7d04389, UNASSIGN 2023-02-15 23:01:54,013 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=77d7b97ad8e23db2d08e4741a7d04389, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:54,013 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676502114013"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676502114013"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676502114013"}]},"ts":"1676502114013"} 2023-02-15 23:01:54,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 77d7b97ad8e23db2d08e4741a7d04389, server=jenkins-hbase4.apache.org,38653,1676502109779}] 2023-02-15 23:01:54,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 23:01:54,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:54,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 77d7b97ad8e23db2d08e4741a7d04389, disabling compactions & flushes 2023-02-15 23:01:54,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:54,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:54,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. after waiting 0 ms 2023-02-15 23:01:54,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:54,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 23:01:54,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389. 2023-02-15 23:01:54,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 77d7b97ad8e23db2d08e4741a7d04389: 2023-02-15 23:01:54,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:54,172 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=77d7b97ad8e23db2d08e4741a7d04389, regionState=CLOSED 2023-02-15 23:01:54,173 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676502114172"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676502114172"}]},"ts":"1676502114172"} 2023-02-15 23:01:54,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 23:01:54,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 77d7b97ad8e23db2d08e4741a7d04389, server=jenkins-hbase4.apache.org,38653,1676502109779 in 159 msec 2023-02-15 23:01:54,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 23:01:54,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=77d7b97ad8e23db2d08e4741a7d04389, UNASSIGN in 163 msec 2023-02-15 23:01:54,176 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676502114176"}]},"ts":"1676502114176"} 2023-02-15 23:01:54,177 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-15 23:01:54,179 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-15 23:01:54,180 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 173 msec 2023-02-15 23:01:54,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 23:01:54,311 INFO [Listener at localhost/34631] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-15 23:01:54,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-15 23:01:54,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-15 23:01:54,314 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 23:01:54,315 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 23:01:54,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 23:01:54,317 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:54,319 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1, FileablePath, hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2, FileablePath, hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/recovered.edits] 2023-02-15 23:01:54,321 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1/5a59d17f469e4f24a95df152ae334f58 to hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/archive/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1/5a59d17f469e4f24a95df152ae334f58 2023-02-15 23:01:54,322 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1/6a19e08dbba444808cb3db0398e3a3ee to hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/archive/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f1/6a19e08dbba444808cb3db0398e3a3ee 2023-02-15 23:01:54,324 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2/3a91234aef40411c95de3ba102707a81 to hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/archive/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2/3a91234aef40411c95de3ba102707a81 2023-02-15 23:01:54,325 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2/3f35a218abe146329dc55d198c13e59e to hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/archive/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/f2/3f35a218abe146329dc55d198c13e59e 2023-02-15 23:01:54,327 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/recovered.edits/12.seqid to hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/archive/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389/recovered.edits/12.seqid 2023-02-15 23:01:54,327 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/.tmp/data/default/testWithMapReduce/77d7b97ad8e23db2d08e4741a7d04389 2023-02-15 23:01:54,327 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 23:01:54,329 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 23:01:54,330 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-15 23:01:54,332 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-15 23:01:54,332 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 23:01:54,333 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-15 23:01:54,333 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676502114333"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:54,334 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 23:01:54,334 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 77d7b97ad8e23db2d08e4741a7d04389, NAME => 'testWithMapReduce,,1676502111241.77d7b97ad8e23db2d08e4741a7d04389.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 23:01:54,334 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-15 23:01:54,334 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676502114334"}]},"ts":"9223372036854775807"} 2023-02-15 23:01:54,335 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-15 23:01:54,336 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 23:01:54,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 24 msec 2023-02-15 23:01:54,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 23:01:54,416 INFO [Listener at localhost/34631] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-15 23:01:54,417 INFO [Listener at localhost/34631] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 23:01:54,417 INFO [Listener at localhost/34631] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 23:01:54,417 DEBUG [Listener at localhost/34631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2549adab to 127.0.0.1:49907 2023-02-15 23:01:54,417 DEBUG [Listener at localhost/34631] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:54,417 DEBUG [Listener at localhost/34631] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 23:01:54,417 DEBUG [Listener at localhost/34631] util.JVMClusterUtil(257): Found active master hash=2076592279, stopped=false 2023-02-15 23:01:54,417 INFO [Listener at localhost/34631] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41827,1676502109732 2023-02-15 23:01:54,425 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:54,425 INFO [Listener at localhost/34631] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 23:01:54,425 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:54,425 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 23:01:54,425 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:54,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:54,427 DEBUG [Listener at localhost/34631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31080d82 to 127.0.0.1:49907 2023-02-15 23:01:54,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:54,427 DEBUG [Listener at localhost/34631] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:54,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 23:01:54,427 INFO [Listener at localhost/34631] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38653,1676502109779' ***** 2023-02-15 23:01:54,427 INFO [Listener at localhost/34631] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:54,427 INFO [Listener at localhost/34631] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37233,1676502109809' ***** 2023-02-15 23:01:54,427 INFO [Listener at localhost/34631] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 23:01:54,428 INFO [RS:0;jenkins-hbase4:38653] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:54,428 INFO [RS:0;jenkins-hbase4:38653] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:54,428 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:54,428 INFO [RS:0;jenkins-hbase4:38653] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:54,429 INFO [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:54,429 INFO [RS:1;jenkins-hbase4:37233] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 23:01:54,429 DEBUG [RS:0;jenkins-hbase4:38653] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a4cf89b to 127.0.0.1:49907 2023-02-15 23:01:54,429 INFO [RS:1;jenkins-hbase4:37233] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 23:01:54,429 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 23:01:54,429 INFO [RS:1;jenkins-hbase4:37233] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 23:01:54,429 DEBUG [RS:0;jenkins-hbase4:38653] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:54,430 INFO [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(3304): Received CLOSE for c84298982c5ea36002899c1c3a54f73b 2023-02-15 23:01:54,430 INFO [RS:0;jenkins-hbase4:38653] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:54,430 INFO [RS:0;jenkins-hbase4:38653] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:54,430 INFO [RS:0;jenkins-hbase4:38653] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:54,431 INFO [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:54,431 INFO [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 23:01:54,431 DEBUG [RS:1;jenkins-hbase4:37233] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49174dd2 to 127.0.0.1:49907 2023-02-15 23:01:54,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c84298982c5ea36002899c1c3a54f73b, disabling compactions & flushes 2023-02-15 23:01:54,431 DEBUG [RS:1;jenkins-hbase4:37233] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:54,431 INFO [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 23:01:54,431 DEBUG [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-15 23:01:54,431 INFO [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 23:01:54,431 DEBUG [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 23:01:54,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. 2023-02-15 23:01:54,431 DEBUG [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(1479): Online Regions={c84298982c5ea36002899c1c3a54f73b=hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b.} 2023-02-15 23:01:54,431 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 23:01:54,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. 2023-02-15 23:01:54,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 23:01:54,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. after waiting 0 ms 2023-02-15 23:01:54,431 DEBUG [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(1505): Waiting on c84298982c5ea36002899c1c3a54f73b 2023-02-15 23:01:54,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. 2023-02-15 23:01:54,431 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 23:01:54,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing c84298982c5ea36002899c1c3a54f73b 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 23:01:54,431 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 23:01:54,431 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 23:01:54,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-15 23:01:54,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/namespace/c84298982c5ea36002899c1c3a54f73b/.tmp/info/b169e313555046f1bc6ef892c9fafe5d 2023-02-15 23:01:54,441 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/.tmp/info/d13af1f7232b43b19e09252b4081ad06 2023-02-15 23:01:54,445 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d13af1f7232b43b19e09252b4081ad06 2023-02-15 23:01:54,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/namespace/c84298982c5ea36002899c1c3a54f73b/.tmp/info/b169e313555046f1bc6ef892c9fafe5d as hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/namespace/c84298982c5ea36002899c1c3a54f73b/info/b169e313555046f1bc6ef892c9fafe5d 2023-02-15 23:01:54,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/namespace/c84298982c5ea36002899c1c3a54f73b/info/b169e313555046f1bc6ef892c9fafe5d, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 23:01:54,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c84298982c5ea36002899c1c3a54f73b in 18ms, sequenceid=6, compaction requested=false 2023-02-15 23:01:54,451 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/.tmp/rep_barrier/2b3e65d6e9b24a6caf1c9df45bf30831 2023-02-15 23:01:54,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/namespace/c84298982c5ea36002899c1c3a54f73b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 23:01:54,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. 2023-02-15 23:01:54,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c84298982c5ea36002899c1c3a54f73b: 2023-02-15 23:01:54,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676502110753.c84298982c5ea36002899c1c3a54f73b. 2023-02-15 23:01:54,455 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:54,455 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:54,457 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b3e65d6e9b24a6caf1c9df45bf30831 2023-02-15 23:01:54,464 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/.tmp/table/2c15bb14ff824e54be1c5866160d323a 2023-02-15 23:01:54,467 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c15bb14ff824e54be1c5866160d323a 2023-02-15 23:01:54,467 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/.tmp/info/d13af1f7232b43b19e09252b4081ad06 as hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/info/d13af1f7232b43b19e09252b4081ad06 2023-02-15 23:01:54,471 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d13af1f7232b43b19e09252b4081ad06 2023-02-15 23:01:54,471 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/info/d13af1f7232b43b19e09252b4081ad06, entries=12, sequenceid=21, filesize=6.2 K 2023-02-15 23:01:54,471 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/.tmp/rep_barrier/2b3e65d6e9b24a6caf1c9df45bf30831 as hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/rep_barrier/2b3e65d6e9b24a6caf1c9df45bf30831 2023-02-15 23:01:54,474 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b3e65d6e9b24a6caf1c9df45bf30831 2023-02-15 23:01:54,475 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/rep_barrier/2b3e65d6e9b24a6caf1c9df45bf30831, entries=1, sequenceid=21, filesize=5.0 K 2023-02-15 23:01:54,475 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/.tmp/table/2c15bb14ff824e54be1c5866160d323a as hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/table/2c15bb14ff824e54be1c5866160d323a 2023-02-15 23:01:54,478 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c15bb14ff824e54be1c5866160d323a 2023-02-15 23:01:54,478 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/table/2c15bb14ff824e54be1c5866160d323a, entries=4, sequenceid=21, filesize=5.0 K 2023-02-15 23:01:54,479 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 48ms, sequenceid=21, compaction requested=false 2023-02-15 23:01:54,479 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 23:01:54,479 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 23:01:54,482 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 23:01:54,482 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 23:01:54,485 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 23:01:54,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:54,485 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 23:01:54,485 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 23:01:54,485 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 23:01:54,631 INFO [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38653,1676502109779; all regions closed. 2023-02-15 23:01:54,631 INFO [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37233,1676502109809; all regions closed. 2023-02-15 23:01:54,638 DEBUG [RS:0;jenkins-hbase4:38653] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/oldWALs 2023-02-15 23:01:54,639 DEBUG [RS:1;jenkins-hbase4:37233] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/oldWALs 2023-02-15 23:01:54,639 INFO [RS:1;jenkins-hbase4:37233] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37233%2C1676502109809:(num 1676502111099) 2023-02-15 23:01:54,639 INFO [RS:0;jenkins-hbase4:38653] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38653%2C1676502109779.meta:.meta(num 1676502110704) 2023-02-15 23:01:54,639 DEBUG [RS:1;jenkins-hbase4:37233] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:54,639 INFO [RS:1;jenkins-hbase4:37233] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:54,639 INFO [RS:1;jenkins-hbase4:37233] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:54,639 INFO [RS:1;jenkins-hbase4:37233] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 23:01:54,639 INFO [RS:1;jenkins-hbase4:37233] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 23:01:54,639 INFO [RS:1;jenkins-hbase4:37233] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 23:01:54,639 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:54,640 INFO [RS:1;jenkins-hbase4:37233] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37233 2023-02-15 23:01:54,643 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:54,643 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:54,643 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37233,1676502109809 2023-02-15 23:01:54,643 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:54,643 DEBUG [RS:0;jenkins-hbase4:38653] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/oldWALs 2023-02-15 23:01:54,643 ERROR [Listener at localhost/34631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@391a447a rejected from java.util.concurrent.ThreadPoolExecutor@3d25d781[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:54,643 INFO [RS:0;jenkins-hbase4:38653] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38653%2C1676502109779:(num 1676502111506) 2023-02-15 23:01:54,643 DEBUG [RS:0;jenkins-hbase4:38653] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:54,643 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:54,643 INFO [RS:0;jenkins-hbase4:38653] regionserver.LeaseManager(133): Closed leases 2023-02-15 23:01:54,643 ERROR [Listener at localhost/34631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@22c75f80 rejected from java.util.concurrent.ThreadPoolExecutor@3d25d781[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:54,643 INFO [RS:0;jenkins-hbase4:38653] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 23:01:54,643 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:54,646 INFO [RS:0;jenkins-hbase4:38653] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38653 2023-02-15 23:01:54,646 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37233,1676502109809] 2023-02-15 23:01:54,646 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37233,1676502109809; numProcessing=1 2023-02-15 23:01:54,647 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 23:01:54,647 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37233,1676502109809 already deleted, retry=false 2023-02-15 23:01:54,647 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38653,1676502109779 2023-02-15 23:01:54,647 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37233,1676502109809 expired; onlineServers=1 2023-02-15 23:01:54,647 ERROR [Listener at localhost/34631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4dab7762 rejected from java.util.concurrent.ThreadPoolExecutor@4994ea0f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:54,648 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38653,1676502109779] 2023-02-15 23:01:54,648 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38653,1676502109779; numProcessing=2 2023-02-15 23:01:54,650 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38653,1676502109779 already deleted, retry=false 2023-02-15 23:01:54,650 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38653,1676502109779 expired; onlineServers=0 2023-02-15 23:01:54,650 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41827,1676502109732' ***** 2023-02-15 23:01:54,650 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 23:01:54,651 DEBUG [M:0;jenkins-hbase4:41827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ff9d337, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 23:01:54,651 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41827,1676502109732 2023-02-15 23:01:54,651 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41827,1676502109732; all regions closed. 2023-02-15 23:01:54,651 DEBUG [M:0;jenkins-hbase4:41827] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 23:01:54,651 DEBUG [M:0;jenkins-hbase4:41827] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 23:01:54,651 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 23:01:54,651 DEBUG [M:0;jenkins-hbase4:41827] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 23:01:54,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502110351] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676502110351,5,FailOnTimeoutGroup] 2023-02-15 23:01:54,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502110351] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676502110351,5,FailOnTimeoutGroup] 2023-02-15 23:01:54,651 INFO [M:0;jenkins-hbase4:41827] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 23:01:54,652 INFO [M:0;jenkins-hbase4:41827] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 23:01:54,652 INFO [M:0;jenkins-hbase4:41827] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 23:01:54,652 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 23:01:54,652 DEBUG [M:0;jenkins-hbase4:41827] master.HMaster(1512): Stopping service threads 2023-02-15 23:01:54,652 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 23:01:54,652 INFO [M:0;jenkins-hbase4:41827] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 23:01:54,653 ERROR [M:0;jenkins-hbase4:41827] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 23:01:54,653 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 23:01:54,653 INFO [M:0;jenkins-hbase4:41827] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 23:01:54,653 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 23:01:54,654 DEBUG [M:0;jenkins-hbase4:41827] zookeeper.ZKUtil(398): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 23:01:54,654 WARN [M:0;jenkins-hbase4:41827] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 23:01:54,654 INFO [M:0;jenkins-hbase4:41827] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 23:01:54,654 INFO [M:0;jenkins-hbase4:41827] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 23:01:54,654 DEBUG [M:0;jenkins-hbase4:41827] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 23:01:54,654 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:54,654 DEBUG [M:0;jenkins-hbase4:41827] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:54,654 DEBUG [M:0;jenkins-hbase4:41827] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 23:01:54,654 DEBUG [M:0;jenkins-hbase4:41827] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:54,655 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.70 KB heapSize=65.67 KB 2023-02-15 23:01:54,662 INFO [M:0;jenkins-hbase4:41827] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.70 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/84a59006baff4f95b8b2b49a0467ac35 2023-02-15 23:01:54,665 DEBUG [M:0;jenkins-hbase4:41827] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/84a59006baff4f95b8b2b49a0467ac35 as hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/84a59006baff4f95b8b2b49a0467ac35 2023-02-15 23:01:54,669 INFO [M:0;jenkins-hbase4:41827] regionserver.HStore(1080): Added hdfs://localhost:46501/user/jenkins/test-data/0af1dc33-8e58-09ff-c92c-27364638705d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/84a59006baff4f95b8b2b49a0467ac35, entries=17, sequenceid=132, filesize=8.6 K 2023-02-15 23:01:54,669 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegion(2947): Finished flush of dataSize ~54.70 KB/56017, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 14ms, sequenceid=132, compaction requested=false 2023-02-15 23:01:54,670 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 23:01:54,670 DEBUG [M:0;jenkins-hbase4:41827] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 23:01:54,672 INFO [M:0;jenkins-hbase4:41827] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 23:01:54,672 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 23:01:54,672 INFO [M:0;jenkins-hbase4:41827] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41827 2023-02-15 23:01:54,673 DEBUG [M:0;jenkins-hbase4:41827] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41827,1676502109732 already deleted, retry=false 2023-02-15 23:01:54,926 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:54,926 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41827,1676502109732; zookeeper connection closed. 2023-02-15 23:01:54,926 ERROR [Listener at localhost/34631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5410b271 rejected from java.util.concurrent.ThreadPoolExecutor@502f2c2b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:54,927 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): master:41827-0x1005a37f7d90000, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:54,927 ERROR [Listener at localhost/34631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7520d82b rejected from java.util.concurrent.ThreadPoolExecutor@502f2c2b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:55,026 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:55,026 INFO [RS:0;jenkins-hbase4:38653] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38653,1676502109779; zookeeper connection closed. 2023-02-15 23:01:55,026 ERROR [Listener at localhost/34631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2bd672cd rejected from java.util.concurrent.ThreadPoolExecutor@4994ea0f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:55,026 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:38653-0x1005a37f7d90001, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:55,026 ERROR [Listener at localhost/34631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@53fa4185 rejected from java.util.concurrent.ThreadPoolExecutor@4994ea0f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:55,026 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@36339a4a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@36339a4a 2023-02-15 23:01:55,126 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:55,126 INFO [RS:1;jenkins-hbase4:37233] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37233,1676502109809; zookeeper connection closed. 2023-02-15 23:01:55,126 ERROR [Listener at localhost/34631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a9fb95a rejected from java.util.concurrent.ThreadPoolExecutor@3d25d781[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:55,127 DEBUG [Listener at localhost/34631-EventThread] zookeeper.ZKWatcher(600): regionserver:37233-0x1005a37f7d90002, quorum=127.0.0.1:49907, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 23:01:55,127 ERROR [Listener at localhost/34631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2bd6d0 rejected from java.util.concurrent.ThreadPoolExecutor@3d25d781[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 23:01:55,127 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3aab6402] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3aab6402 2023-02-15 23:01:55,127 INFO [Listener at localhost/34631] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 23:01:55,127 WARN [Listener at localhost/34631] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:55,143 INFO [Listener at localhost/34631] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:55,248 WARN [BP-2129546034-172.31.14.131-1676502109152 heartbeating to localhost/127.0.0.1:46501] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 23:01:55,248 WARN [BP-2129546034-172.31.14.131-1676502109152 heartbeating to localhost/127.0.0.1:46501] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2129546034-172.31.14.131-1676502109152 (Datanode Uuid 5b62c87f-a2b0-4400-9d6a-b056fdfb9e26) service to localhost/127.0.0.1:46501 2023-02-15 23:01:55,249 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/cluster_e2fecff1-f66f-f2b8-63e8-80a828581726/dfs/data/data3/current/BP-2129546034-172.31.14.131-1676502109152] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:55,249 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/cluster_e2fecff1-f66f-f2b8-63e8-80a828581726/dfs/data/data4/current/BP-2129546034-172.31.14.131-1676502109152] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:55,250 WARN [Listener at localhost/34631] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 23:01:55,253 INFO [Listener at localhost/34631] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:55,254 WARN [BP-2129546034-172.31.14.131-1676502109152 heartbeating to localhost/127.0.0.1:46501] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 23:01:55,254 WARN [BP-2129546034-172.31.14.131-1676502109152 heartbeating to localhost/127.0.0.1:46501] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2129546034-172.31.14.131-1676502109152 (Datanode Uuid 00693cc8-4d78-420f-9e5b-3b07e958750d) service to localhost/127.0.0.1:46501 2023-02-15 23:01:55,255 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/cluster_e2fecff1-f66f-f2b8-63e8-80a828581726/dfs/data/data1/current/BP-2129546034-172.31.14.131-1676502109152] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:55,255 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c1ffced0-4512-c5ab-21de-2fa31089c0ef/cluster_e2fecff1-f66f-f2b8-63e8-80a828581726/dfs/data/data2/current/BP-2129546034-172.31.14.131-1676502109152] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 23:01:55,264 INFO [Listener at localhost/34631] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 23:01:55,377 INFO [Listener at localhost/34631] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 23:01:55,393 INFO [Listener at localhost/34631] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 23:01:55,407 INFO [Listener at localhost/34631] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=294 (was 273) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:46501 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34631 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:46501 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:46501 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:46501 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:46501 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:46501 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41827,1676502109732)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46501 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=600 (was 576) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=330 (was 333), ProcessCount=166 (was 166), AvailableMemoryMB=2484 (was 2534)